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CHAPTER 1 


Introduction to Trading Bot 


Welcome to the world of automated trading! The fact that you are reading this book 
suggests that you want to probably build your own bot, which hopefully can make you 
some money while you are busy with your day job or, like me, want to experiment with 
the technology that goes into building such a bot using Java. 

Automated trading has been around for a while, although it has largely been a 
preserve of big players such as banks and hedge funds. 

This has changed in the last few years, however. Many retail investors are now able 
to trade on various platforms and exchanges directly, instead of using the services of a 
traditional broker on the phone, which means the demand has been growing to automate 
the task of placing orders while these investors get on with their day jobs. As a first step in 
automating this process, many platforms such as OANDA, LMAX, etc., provide APIs for 
various programming languages such as Java, Python, C#, and PHP so that the mundane 
tasks of watching the market, looking at charts, and doing analysis can be automated. 

On this journey, we will focus not only on the concepts of automated trading, but 
also on writing clean, test-driven Java programs. 

Toward the end, we will not only have a working trading bot that is ready to 
trade with any strategy, but from a technical perspective, we will have also gained an 
appreciation of the event-driven, multithreaded world of Java programming. 


Warning Trading foreign exchange on the margin carries a high level of risk, and may 
not be suitable for all investors. Past performance is not indicative of future results. The 
high degree of leverage can work against you as well as for you. Before deciding to invest 
in foreign exchange, you should carefully consider your investment objectives, level of 
experience, and risk appetite. The possibility exists that you could sustain a loss of some 
or all of your initial investment and therefore you should not invest money that you cannot 
afford to lose. You should be aware of all the risks associated with foreign exchange trading 
and seek advice from an independent financial advisor if you have any doubts. 


Electronic supplementary material The online version of this chapter 
(doi:10.1007/978-1-4842-2520-2_1) contains supplementary material, which is available to 
authorized users. 


© Shekhar Varshney 2016 1 
S. Varshney, Building Trading Bots Using Java, DOI 10.1007/978-1-4842-2520-2_1 


CHAPTER 1 — INTRODUCTION TO TRADING BOT 


What Is a Trading Bot? 


In very simple language, a trading bot is a computer program that can automatically place 
orders to a market or exchange, without the need for human intervention. The simplest of 
bots could be a curl! POST to an OANDA REST API, such as 


1  $curl -X POST -d "instrument=EUR_USD&units=2&side=sell&type=market" 
"https: //api-fxtrade.oanda.com/v1/accounts/12345/ord\ 
2 ers" 


which can be set up on a UNIX cron’ to run every hour, during trading hours. It has no 
strategy, nor any external interface or dependencies. It is a one-liner to place an order, 
which has an equal probability to be in profit or in loss. 

On the other end of the spectrum, it could be a complex program based ona 
distributed architecture, consuming lots of feeds from various sources, analyzing them in 
realtime and then placing an order. It will be highly available with extremely low latency. 

The scale and scope of the bot, as we can see, is varied. To be effective, the bot 
should be able to accomplish the following tasks: 


e Consume market data and/or external news events and social 
media feeds and distribute them to interested components within 
the system. 


e Have at least one strategy that provides a trading signal. 


e Based on a trading signal, place orders with the brokerage 
platform. 


e Account management, i.e., have the ability to keep track of margin 
requirements, leverage, PNL, amount remaining, etc., in order to 
curb trading if the amount available breaches a given threshold. 


e = Position management, i.e., keep track of all currently active 
positions of various instruments, units of such positions, average 
price, etc. 


e Have the ability to handle events which are triggered by the 
brokerage platform such as ORDER_FILLED, STOP_LOSS, etc., and if 
required take appropriate decisions for such events. 


e Some basic monitoring and alerting. 


e Some basic risk management. For example, loss limitation 
by using stop losses for orders or making sure that risk is 
distributed between risky and safe haven instruments. These 
are just examples and by no means a comprehensive list of fully 
managing the risk. 


'https://en.wikipedia.org/wiki/CURL 
*https://en.wikipedia.org/wiki/Cron 
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Why Do We Need a Trading Bot? 


I believe most of services provided by exchanges/platforms revolve around the following: 


e = Market data subscription for instruments of choice and 
dissemination 


e —_- Place orders and trades 

e Account and position management 

e Historic market data 

e  =Heartbeating 

e Callbacks for trade, order, and account events 
e = Authentication 


The trading bot is an attempt to generalize these tasks in a framework and 
provide an ability to provide the broker/exchange platform specific implementation at 
runtime, using a dependency injection*® framework like Spring. Therefore, theoretically 
speaking, it will just be a change in the Spring configuration file, where we define our 
implementations for various interfaces that implement these services, and voila, we 
should be able to support various broker/exchange platforms. 


The Capabilities of the Trading Bot 


Our bot will have the following capabilities, which are discussed in detail in later 
chapters: 


e Account management 

e Integrate with realtime market data feed 
e Disseminate of market data 

e —_- Place orders 

e Handle order/trade and account events 
e = Analyze of historic prices 

e Integrate with Twitter 


e Develop strategies 


https: //en.wikipedia.org/wiki/Dependency_injection 
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Design Goals 


One of the key design goals, alluded to in the beginning of this chapter, is to have the 
ability to change the implementation of a broker/exchange platform at runtime through 
Spring configuration. This is possible if we can create specifications for these platform 
API calls, very similar to the JDBC specification. For example, a sample specification/ 
interface defining the position management requirements are as follows: 


/** 

2 * A provider of services for instrument positions. A position for an 
instrument 

3 * is by definition aggregated trades for the instrument with an 
average price 

4 * where all trades must all be a LONG or a SHORT. It is a useful 
service to 

5 * project a summary of a given instrument and also if required close 
all trades 

6 * for a given instrument, ideally using a single call. 


8 * The implementation might choose to maintain an internal cache of 
positions in 
9 * order to reduce latency. If this is the case then it must find means 


to 

10 * either 1) hook into the event streaming and refresh the cache based 
on an 

11 * order/trade event or 2) regularly refresh the cache after a given 
time 

12 * period. 

13 = 

14 * @param <M> 

15 * The type of instrumentId in class TradeableInstrument 

16 * @param <N> 

17 ‘if the type of accountId 

18 * 

19 * @see TradeableInstrument 

20 */ 

21 +public interface PositionManagementProvider<M, N> { 

22 

23 /** 

24 * 

25 * @param accountId 

26 * @param instrument 

27 * @return Position<M> for a given instrument and accountId(may 

be null if 
28 % all trades under a single account). 
29 */ 


30 


31 
32 
33 
34 
35 


36 
37 
38 
39 
40 


41 


42 
43 
44 
45 
46 
47 


48 
49 } 
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Position<M> getPositionForInstrument(N accountId, 
TradeableInstrument<M> instrument) ; 


/** 

* 

* @param accountId 

* @return Collection of Position<M> objects for a given 
accountId. 

*/ 

Collection<Position<M>> getPositionsForAccount(N accountId) ; 


/** 

* close the position for a given instrument and accountId. 
This is one shot 

* way to close all trades for a given instrument in an 
account. 

* 

* @param accountId 

* @param instrument 

* @return if the operation was successful 

*/ 

boolean closePosition(N accountId, TradeableInstrument<M> 

instrument) ; 


If we create such specifications/interfaces for each aspect of the platform interaction, 
we can in theory create providers for these services and swap them when required, 
through the Spring configuration. From code organization perspective, all these 
interfaces, therefore, go in a project that forms part of the core API. This project will 
therefore be broker/exchange provider-agnostic and will comprise such interfaces and 


services. 


Write services that solve a single business problem or a collection 
of related problems. These services lend themselves to easy unit 
testability and code reuse that eventually leads to better software 


quality. 


Loosely couple services. This enables reducing system 
dependencies and as a result results in more maintainable 
software. Our software will be continuously evolving as one might 
decide to integrate more social media feeds or add more complex 
strategies. Writing loosely coupled components ensures that we 
have little knockon effect on already working code. 


CHAPTER 1 
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High unit test coverage. It is extremely important that we aim 

to have a high unit test coverage. When used in a production 
environment where real money could be involved, large unit tests 
coverage will ensure that we catch regressions and bugs early on 
and prevent the manifestation of bugs as much as possible in the 
production environment. 


Code Organization and Software Stack Used 


Following on from our discussion of design goals in the previous sections, the code 

will be organized in at least three different projects. That means at least three JAR files 
will be produced from the build. Why are we saying at least three? Remember from 

our earlier discussion, that one of the key design goals is to be able to switch provider 
implementation at runtime. Since we could have more than one provider from which we 
can decide, there will be at least three JAR files (see Figure 1-1). We are going to discuss 
only one implementation in the book, i.e., the OANDA REST API implementation. 


Developers who use the framework are encouraged to develop more provider 
implementations: 


trading-core is the core of the project. It comprises all the 
specifications/interfaces that must be implemented. It also 
comprises all the generic services that use the core interfaces and 
provide additional useful API methods. 


oanda-restapi is our reference implementation for the 
specification and will be discussed in the book. You are more than 
welcome to swap this with your own. 


tradingbot-app is the main application that uses Spring to inject 
the provider API at runtime. It is also the project where we define 
our strategies and can implement app-specific stuff. Later in the 
book, we are going to talk about integration with social media, 
especially Twitter, which we will implement in this project. 


CHAPTER 1 — INTRODUCTION TO TRADING BOT 
{8 Package Explorer 53 fg Type Hierarchy Ju JUnit a J 


> Su oanda-restapi ([code-repo master) 
b Sa > tradingbot-app [code-repo master) 
v ey tradingbot-core [code-repo master) 
> 3 com.precioustech.fxtrading 
> 3 com.precioustech.fxtrading.account 
> & com.precioustech.fxtrading.account.transaction 
> £3 com.precioustech.fxtrading.events 
> 3 com.precioustech.fxtrading.events.notification.email 
>  com.precioustech.fxtrading.heartbeats a 
> 3 com.precioustech.fxtrading. helper 
> 3 com.precioustech.fxtrading.instrument 
>  com.precioustech.fxtrading.marketdata 
> &R com.precioustech.fxtrading.marketdata. historic 
> &} com.precioustech.fxtrading.order 
> 3 com.precioustech.fxtrading.position 
> 3 com.precioustech.fxtrading.streaming.events 
> & com.precioustech.fxtrading.streaming. heartbeats 
> &} com.precioustech.fxtrading.streaming.marketdata 
> £3 com.precioustech.fxtrading.trade 
> fea! com.precioustech.fxtrading.trade.strategies 
> 3 com.precioustech.fxtrading.utils 
> GF srcjtest/java 
> GF src/test/resources 
> wa JRE System Library (JavaSE-1.7) 
> mA Maven Dependencies 
> Sysre 
@& target 
{a} pom.xm! { 


Figure 1-1. Java projects 


To build our bot we are going to use the following set of software and tools: 
e = Java SDK 1.7+ 


e Spring Framework 4.1, Spring Social 1.1 (dependency in the 
tradingbot-app project only) 


e Guava 18.0 

e = HttpClient 4.3 
e = =Maven 3.2.5 

e Eclipse IDE 
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OANDA REST API as Reference Implementation 


Note | have no current or past commercial relationship with OANDA and | have chosen 
OANDA REST API as a reference implementation simply on its technical merit and the 
fact that it is likely to have wider adoption as it is free to use. If there is something similar 
around, | would be happy to give it a try as well. 


I encountered the OANDA API by chance. At the time, I was looking for a broker 
who was offering a free API for trading (just in case I wanted to convert to a production 
account) and more importantly supported the Java programming language. It was 
very easy to get started, as most of the examples used curl to demonstrate various 
trading actions like getting a list of instruments, placing an order, or getting historical 
candlesticks data. I could just type the curl commands on my Mac terminal and fire away. 
I could easily see the JSON response received with each curl request fired. By seeing the 
responses and data in realtime, I got a really good idea and appreciation of various APIs 
supporting instruments, orders, rates, positions, etc. 

The curl command examples was a good starting point and I started to experiment 
writing equivalent commands as test cases in Java described on the REST API’ page. 


Opening an OANDA Practice Account 


Before you can start using the API, you must sign up for a free practice® account. When 
you head there and click on open an account button, you will see a signup screen like the 
one shown in Figure 1-2. 


“http://developer.oanda.com/rest-live/introduction/ 
http: //fxtrade.oanda.com 
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iN) OANDK PX | De| En| Es| Fr} it] Pt] Py 


Sign Up In Minutes 


Open an fxTrade Practice account today and experience OANDA's award-winning platforms ~ fxTrade, MT4, and Mobile. Trade confidently 
with OANDA's competitive spreads and exceptional execution. 


ies Sa CO Unlimited Virtual Funds 
Use virtual funds to gain insight only trading experience 
can provice. 

a = 4) Never Expires 


Trace uncer real market conditions with live prices and 
soreacs, for as long as you want. 
Username Username 


Must be 2-50 aiphanumenc characters 0 Five Trading Platforms 


Croose the trading platform that suits you and your 
investing 
Must be 6-15 characters in length 


Phone CF - Pray Prone NutOer 


By chcking Sign Up | confirm tnat 


| agree that OANDA may contact me to provide 
information on &s products anc services and to 
assist me in using fxTrace Practice. 


Figure 1-2. Oanda account signup 


Once you have successfully signed up, you are now ready to sign in to your practice 
account. You will see the login screen shown in Figure 1-3 when you are ready to log in. 
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( OANDA. Q 


News & Analysis 


Secure Sign In 


Upcoming System Maintenance Notice: 
For details about the upcoming platform maintenance, please click here 


eo Holiday notice: 
For details about markets affected by holidays. please click hore 


svarsnney 


Don't Have an Account? 


Get the OANDA Advantage. Sign up for a currency trading account. 


Launch Trading Platform (Submit 


Figure 1-3. Oanda account login 


After a successful sign on, you are taken to the account home page, which looks like 
the screen in Figure 1-4. 


( N) OANDAXV My Account Sign out Q 


Why OANDA s Cartency Conwerter 


My fxTrade Practice Account ee 


Upcoming System Maintenance Notice: 
For details about the upcoming platform maintenance, please click here 


Oo Holiday notice: 
For details about markets affected by holdays, please chick here 


LAUNCH FXTRADE NEWS > 


Accounts MT4 Currency Balance 


Primary 3508556 CHF Fr. 100°000.00 


EA aera 
Trade for real 
Open an fxTrade secount to To update your info, please contact Custome 


trade live and access real-time Contes 
> Change Leverage ( end wade ene! 
> View Detailed Transaction History » 


> Change Password 
> Manage External Applications | REGISTER FOR FXTRADE + 


+> Manage API Access 5 bd = 
Manage Email Subscription 
> Set up MotaTracer 4 


Figure 1-4. Oanda account dashboard 
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In order to commence API trading, we need to first generate a personal API token, 
which will be used by the OANDA platform to authenticate the request. You need to click 
on the Manage API Access link, highlighted by a arrow in Figure 1-4. You will next be 
taken to the screen shown in Figure 1-5. 


1) OANDA iyfcen >) Cape 


US. 
Why OANDA rations Markets Academy News & Anayss ‘Support Currency Converter Soksions te JAPAN 


Manage API Access /\ P| 


Your key to OANDA's API 


o ing thal you have reac, understand, and 
y the API License Agreement 


* By clicking Generate, you a 
gree 10 be legally D 


Get started using OANDA's API 


Figure 1-5. Oanda generate API token 


When you click Generate, the platform will generate a token with you, which must be 
included in every request you make to the platform that hosts your practice account. The 
token generated will be presented and you must make a note of it (see Figure 1-6). 
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AUSTRALIA 


Us 


Manage API Access /\ P| 


Your key to OANDA's API 


0/0/01 PERCTTESTESOSEEET ESTE TES IO ErnCeoEIECEES [*) 
Picase note, tokens are unique t0 cach OANDA account and snoulc be stored securoly 


Figure 1-6. Oanda generated token 


Now you are ready to trade. OANDA provides a very useful web interface’ to test 
your REST requests and see the responses in situ. You can also get a feeling of how the 
REST resource URLs are organized and which resource URL to invoke for fulfilling a given 
request. 

The screen in Figure 1-7 demonstrates how we make a request to get a list of all 
instruments that can be traded. The GET request requires an account ID to be passed in 
(this is the ID that you can find on the account page and for a practice account, comes 
loaded with 100,000 units of the account currency). It is imperative to provide the header 
as well and can be specified as Bearer <Your API Token goes here> (see Figure 1-8). 


http: //developer.oanda.com/rest-live/console/ 
??utm_source=oandaapi&utm_medium=link&utm_campaign=accesstoken_email 


12 


CHAPTER 1 INTRODUCTION TO TRADING BOT 


Description 


accounsic* 350877 The accourt 1s to teich the it of traceable nsvumens tor ® 


feces AUREL encoded (WiC) comes separated Inst of instrument ics at are to be retumec in the response, Sew 
Gocunertation for all vad waives 


GET /vi/instruments?accountId=3508556 HTTP/1.1 
Aethor (set (or Leorer (initiates 
<ob89Sec31 298 /5150cOSef é2dbcochS 

Fost: opi-fxprect\ce.condo.com 

A-Torget-URI: nttps://opl~fxproctice.cands.com 

Connection: Keep-alive 


BITP/1.1 200 OK 
ETog: “1D9ISZEc fIRCMIISHTIDaFOFITZA III FETA” 
Date: Fri, 18 Jon 2016 21242-11 GMT 
Content-Length: 14497 

Expires: Sat, 16 Jon 2016 21:42:11 Gxt 
Cormection: heep-alive 

Content-Type: appl icat ier json 

Server: openresty/1.7.0.4 


Figure 1-7. Oanda dev API console 


hétpsflapetepenction cana $ 


Petpsiant Dgractice conda com’ Vieatnuments acne tide EOBSES 


GET /vl/instruments?accountId=3508556 HTTP/1.2 HTTP/1.1 200 OK 


LANG 00! Le LT Etog: “20U6S2Ecf 599421592 320f84 37204333 6701" 
08898 0c3 119815150005 42coco0bS Cote: Fri, 28 Jan 2826 21:45:54 Grr 

Host: ept-faproctice.canda.com Content-Length: 14497 

X-Torget-URI: https: //opt-faproctice.conda.con Expires: Sot, 26 Jon 2026 21:45:53 Gut 
Connection: Keep-Alive Conmaction: ceep-clive 


Content-Type: opel ications json 
Server: openresty/2.7.0.1 


at 
inetramentens wl 


Figure 1-8. Oanda dev API console-headers tab 


OANDA JSON Keys 


The OANDA JSON responses use a set of standard keys. For example, to denote a 
currency pair in a response, the key instrument is used, whether it’s a streaming response 
for tick or candlestick information. A tick in the live stream would look like this: 


1 {"tick": {"instrument": "AUD CAD", "time": "1401919217201682", "bid": 1.01484 
y"ask":1.01502}} 
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Whereas the response, when a trade is successfully modified, would like this: 


1 { 
2 

3 "units": 
4 

5 

6 

7 

8 

9 

10 

x ied 
12} 


"id": 1800805337, 

3000, 

"side": "sell", 
“instrument”: "CHF JPY", 


"time": "2015-03-181T06:33:36.000000Z", 
"price": 120.521, 
“takeProfit": 110, 
"stopLoss": 150, 
"trailingStop": 0, 
"trailingAmount": 0 


From these two examples, we can also see the key used for event date is time. Since 
the same keys are used to denote a given attribute, we can create public static final 
String variables for these keys. So therefore the concept of the class OandaJsonKeys was 
born. Instead of polluting the code with these lines in many classes 


1 String instrument = (String) instrumentJson.get("instrument") ; 


it is much better practice to create a constant and use that instead. The same code 
snippet would look like this: 


1 String instrument = (String) instrumentJson.get(OandaJsonKeys. 


instrument) ; 


There are a lot of keys, but most of the keys that we use in our trading bot are 
captured in the OandaJsonKeys class. 


1 
2 
3 
4 
5 
6 
7 
8 
9 
0 


public class OandaJsonKeys { 


private OandaJsonKeys() { 


} 


public 
public 
public 
public 
public 
public 
public 
public 
public 
public 
public 
public 
public 


static final 
static final 
static final 
static final 
static final 
static final 
static final 
static final 
static final 
static final 
static final 
static final 
static final 


String 
String 
String 
String 
String 
String 
String 
String 
String 
String 
String 
String 
String 


accounts = "accounts"; 

accountId = "accountId"; 
accountCurrency = "accountCurrency"; 
marginRate = "marginRate"; 
marginUsed = "marginUsed"; 
marginAvail = "marginAvail"; 


balance = "balance"; 
unrealizedPl = "“unrealizedP1"; 
realizedPl = "realizedP1"; 
openTrades = "openTrades"; 


instruments = "instruments"; 
instrument = "instrument"; 
interestRate = "interestRate"; 
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19 public static final String disconnect = "disconnect"; 
20 public static final String pip = "pip"; 

21 public static final String bid = "bid"; 

22 public static final String ask = "ask"; 

23 public static final String heartbeat = "heartbeat"; 

24 public static final String candles = "candles"; 

25 public static final String openMid = "openMid"; 

26 public static final String highMid = "highMid"; 

27 public static final String lowMid = "lowMid"; 

28 public static final String closeMid = "closeMid"; 

29 public static final String time = "time"; 

30 public static final String tick = "tick"; 

31 public static final String prices = "prices"; 

32 public static final String trades = "trades"; 

33 public static final String tradeId = "tradeId"; 

34 public static final String price = "price"; 

35 public static final String avgPrice = "avgPrice"; 

36 public static final String id = "id"; 

37 public static final String stopLoss = "stopLoss"; 

38 public static final String takeProfit = "takeProfit"; 
39 public static final String units = "units"; 

40 public static final String side = "side"; 

41 public static final String type = "type"; 

42 public static final String orders = "orders"; 

43 public static final String orderId = "orderId"; 

44 public static final String positions = "positions"; 

45 public static final String expiry = "expiry"; 

46 public static final String tradeOpened = "tradeOpened"; 
47 public static final String orderOpened = "orderOpened"; 
48 public static final String transaction = "transaction"; 
49 public static final String pl = "pl"; 

50 public static final String interest = "interest"; 

51 public static final String accountBalance = "accountBalance"; 
52} 


In all our OANDA API implementations, which will be discussed in the subsequent 
chapters, we directly use this class and statically importing constants instead of 
hardcoding the string literals for a given JSON key. 


Constructor Dependencies for OANDA Implementations 


All OANDA implementations of the core API specifications have constructors that accept 
the following: 


e = =©APIURL 
e Username 


e ~—- Access token 
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As we know, OANDA has different environments where we can run our bot, such as 
sandpit, practice, and live. These environments have different URLs and access tokens 
and can have different usernames for the same individual. These external configuration 
properties are passed in as constructor parameters for various OANDA implementations. 
For example: 


1 public OandaAccountDataProviderService(final String url, final String 
userName, final String accessToken) { 

this.url = url; 

this.userName = userName; 

this.authHeader = OandaUtils.createAuthHeader(accessToken) ; 


mW PWN 


} 


The parameters are passed to this implementation in the Spring configuration, as 
shown here: 


1 <bean id="accountDataProvider" class="com.precioustech. fxtrading.oanda. 
restapi.account .OandaAccountDataProviderService"> 


2 <constructor-arg index="0" value="${oanda.url}"/> 
3 <constructor-arg index="1" value="${oanda.userName}"/> 
4 <constructor-arg index="2" value="${oanda. 


accessToken}"/> 
5 </bean> 


Since these variables are provided in a property file, we can easily change them at 
runtime, without having to do a new build or change code. It would be sufficient to just 
change the property file. We will cover this topic in more detail in later chapters when we 
talk about configuration in detail. 


Event-Driven Architecture 


The soul of any trading system is its event-driven architecture. The system must react to 
market events, social media events, user events, and maybe a plethora of other events 
coming from external/internal sources. These events could further trigger a chain 
reaction of events, resulting in state changes of various business/domain objects in the 
system. The real technical challenge is to make sure that these state transitions happen in 
a thread-safe way, backed by a transaction wherever required. 

At the heart of an event-driven system are one or more event loops. These event 
loops typically run in an infinite while loop and wait on an event to come from a queue or 
a live stream. For an Oanda market data tick event, we have an event loop as following: 


this.streamThread = new Thread(new Runnable() { 


@O0verride 
public void run() { 
CloseableHttpClient httpClient = getHttpClient(); 


try { 


Au fPWN PR 
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7 BufferedReader br = setUpStreamIfPossible(httpClient) ; 

8 if (br != null) { 

9 String line; 

10 while ((line = br.readLine()) != null && serviceUp) { 
11 Object obj = JSONValue.parse(line) ; 

12 JSONObject instrumentTick = (JSONObject) obj; 

13 sae 

14 


In this code snippet, we have an infinite while loop that listens on new ticks being 
pushed on to the live stream by the OANDA platform. When a tick JSON payload is 
received, it is parsed and further disseminated via a queue or an event bus (see Figure 1-9). 


Market Event Stream L me ‘Order/Trade Event 
' C Loop 


(Market Event Loop ) 


EVENT BUS 


Post To 
EventBus 


Callback to Strategy ORDER Queue 
Component 


Figure 1-9. Typical Event Chain 


Figure 1-9 depicts a typical chain of events that might be triggered by a single event. 
1. Tick event is received from the stream. 
2. Event is parsed and sent to an event bus. 


3. The strategy component has a subscription for this event and 
gets a callback from an event bus. 


4. The strategy component decides to generate a trading signal 
based on the latest tick data event and places the signal on an 
OrderQueue. 


5. The OrderExecutionService picks up this signal, creates a 
new order payload, and posts it to the platform. 


6. The platform executes the order and sends an event down the 
order event loop. 


7. This event can further trigger an update of, say, the trades 
cache. 
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This basically is the essence of an event-driven architecture. Since we could have 
many components at play at the same time, it is extremely important that we decouple 
components as much as possible, so that new publishers and subscribers can be added 
with zero or minimal changes. This architecture lends itself to take advantage of Java 
multithreaded programming capabilities. However, by the same token, it dictates the 
developer to exercise great caution when performing state changes of business objects 
present in caches, for example, the trades cache in our example. We must put adequate 
synchronization and locking in place to make sure that the observed state of a shared 
object is always consistent. 


Google EventBus 


Google EventBus’, which is part of the guava library, is an excellent broker to facilitate 
loose coupling of our services and to allow a publish-subscribe style of communication 
between them. The coolest feature about it is the ability to add subscribers just by adding 
an annotation without having the explicit need of knowing who the publisher is. 

Lots of useful information is found on the wiki page of the EventBus, but it is 
worth discussing how it is used in the trading bot ecosystem. Let’s take the use case of a 
disseminating market data event to one or multiple subscribers. Assuming a singleton 
EventBus has been created by the Spring DI container: 


e Register Subscribers automatically: Here we write a 
BeanBostProcessor to automatically find beans that have 
methods annotated by the @Subscribe annotation and call the 
eventBus. register method to register the subscribers. 


1 public class FindEventBusSubscribers implements BeanPostProcessor { 

2 

3. @Autowired 

4 private EventBus eventBus; 

5 private static final Logger LOG = Logger.getLogger(FindEventBusSubscri 
bers.class); 

6 


7  @Override 

8 public Object postProcessAfterInitialization(Object bean, String 
beanName) throws BeansException { 

9 Method[] beanMethods = bean.getClass().getMethods(); 

10 for (Method beanMethod: beanMethods) { 


11 if (beanMethod.isAnnotationPresent(Subscribe.class)) { 

12 eventBus. register (bean) ; 

13 LOG. info( 

14 String. format("Found event bus subscriber class %s. Subscriber 
method name=%s", 

15 bean.getClass().getSimpleName(), beanMethod.getName())); 

16 break; 


https: //code.google.com/p/guava-libraries/wiki/EventBusExplained 
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} 


return bean; 


} 


@Override 

public Object postProcessBeforeInitialization(Object bean, String 
beanName) throws BeansException { 

return bean; 


} 
} 


¢ Create publisher: It is sufficient to just call post (Object payload) 
to post it to the EventBus. 


public MarketEventHandlerImpl(EventBus eventBus) { 
this.eventBus = eventBus; 


public void onMarketEvent(TradeableInstrument < T > instrument, double 


bid, double ask, DateTime eventDate) { 

MarketDataPayLoad < T > payload = new MarketDataPayLoad < T > 
(instrument, bid, ask, eventDate); 

eventBus.post (payload) ; 

i 


e Consume payload: The EventBus finds the appropriate subscriber 
by matching the method signature based on the input type passed 
into the method and annotated by the @Subscribe annotation. 
This method must have one and only one input parameter. There 
is a choice to go as fine-grained or coarse-grained as possible. 

In the case of coarse-grained subscription, we have the input 
parameter as an object, which is the super class of all known 
payloads in the system. The worst case being the payload java. 
lang. Object, in which case the subscription is the most coarse- 
grained. This method will be called for every eventBus.post 
performed in the system. On the other hand, using individual 
subtypes as input parameters to methods makes it extremely 
fine-grained. In the following example, handleMarketDataEvent 
will only be called by the EventBus if the payload is of the type 
MarketDataPayLoad or any of its subtypes. 


@Subscribe 

@AllowConcurrentEvents 

public void handleMarketDataEvent (MarketDataPayLoad<T> 
marketDataPayLoad) { 
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if (instrumentRecentPricesCache.containsKey 
(marketDataPayLoad.getInstrument())) { 
instrumentRecentPricesCache. get ( 
marketDataPayLoad.getInstrument()) 
. put (marketDataPayLoad. getEventDate() ,marketDataPayLoad) ; 


Provider Helper Interface 


Often different platform providers have different notations for denoting a currency pair. 
Cable can be denoted in the following ways: 


like this: 
1 /** 
2 * 
3 
4 * 
5 sf 
6 
7 
8 /** 
9 * 
10 
11 
12 
13 
14 
15 
16 [rt 
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GBP_USD 
GBPUSD 

GBP/USD 
GBP-USD 


Similarly, the act of buying a currency pair could be denoted by: 


buy 
long 
+1 (or any other positive number) 


Platform specific enum, for example, TRADEACTION. BUY 


In order to deal with such variances in notation provided by different providers, we 
need to create an interface that provides methods to address these differences. It looks 


* @param <T> 


The type of Long/Short notation 


public interface ProviderHelper < T > { 


* @param instrument 


in ISO currency standard, such as GBPUSD 


* @return currency pair denoted in the platform specific format 


*/ 


String fromIsoFormat(String instrument) ; 
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17 i 

18 * @param instrument 

19 il in platform specific format such as GBP_USD 

20 * @return currency pair denoted in ISO format 

21 */ 

22 String toIsoFormat(String instrument) ; 

23 

24 /** 

25 i 

26 * @param instrument 

27 = in a 7 character format, separated by an arbitrary 
separator 

28 . character like -,/,_ 

29 * @return currency pair denoted in the platform specific format 

30 */ 

31 String fromPairSeparatorFormat (String instrument) ; 

32 

33 /** 

34 * 

35 * @param instrument 

36 is denoted as a hashtag, for e.g. #GBPUSD 

37 * @return currency pair denoted in the platform specific format 

38 */ 

39 String fromHashTagCurrency(String instrument) ; 

40 

41 /** 

42 . 

43 * @return T that denotes the action of Buying the currency pair on the 

44 * platform 

45 */ 

46  T getLongNotation(); 

47 

48 es 

49 * 

50 * @return T that denotes the action of Selling the currency pair on 

the 

51 7 platform 

52 */ 

53 T getShortNotation(); 

54} 


The need for this interface was felt, when I was consuming data from external 
sources like Twitter and sites that publish economic events. Various Twitter users and 
external sites had their own way of denoting currency pairs and long/short trades. In 
order to deal with this plethora of conventions, the need for such interface was strongly 
felt. 1am pretty sure that there will be many more, which need to be interpreted in 
platform-specific ways and should therefore be added to this interface. 
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TradingConfig Class 


The class TradingConfig holds all the parameters that are configured at runtime. These 
parameters are required by various core APIs. Some examples include 


e Maximum value ofan order to be placed 
e Maximum allowed contracts for a currency 


As different users may have different runtime values, these values form part of the 
external configuration. These need to be configured in the Spring configuration (we 
will discuss it in detail when we talk about configuration and deployment). It is strongly 
recommended to configure as much as possible instead of hardcoding them inside 
various services. 

Let’s check out how the code looks: 


public class TradingConfig extends BaseTradingConfig { 


1 
2 
3 private String mailTo; 

4 private int fadeTheMoveJumpReqdToTrade; 
5 private int fadeTheMoveDistanceToTrade; 
6 private int fadeTheMovePipsDesired; 

7 private int fadeTheMovePriceExpiry; 

8 
9 
0 


public int getFadeTheMovePriceExpiry() { 
return fadeTheMovePriceExpiry; 
11 } 


13 public void setFadeTheMovePriceExpiry(int fadeTheMovePriceExpiry) { 
14 this. fadeTheMovePriceExpiry = fadeTheMovePriceExpiry; 


15} 

16 

17. ~—spubliic String getMailTo() { 

18 return mailTo; 

19 } 

20 

21 public void setMailTo(String mailTo) { 
22 this.mailTo = mailTo; 

23} 

24 


25 public int getFadeTheMoveJumpReqdToTrade() { 
26 return fadeTheMoveJumpReqdToTrade; 
27 } 


29 public void setFadeTheMoveJumpReqdToTrade(int 
fadeTheMoveJumpReqdToTrade) { 

30 this. fadeTheMoveJumpReqdToTrade = fadeTheMoveJumpReqdToTrade; 

31 } 


33 
34 
35 
36 
37 


38 
39 
40 
41 
42 
43 
44 
45 
46 
47 
48 
49 
50 
51 
52 
53 
54 
55 
56 
57 
58 
59 
60 
61 
62 
63 
64 
65 
66 
67 
68 
69 
70 
71 
72 
73 
74 
75 
76 
77 
78 
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public int getFadeTheMoveDistanceToTrade() { 
return fadeTheMoveDistanceToTrade; 


} 


public void setFadeTheMoveDistanceToTrade(int 
fadeTheMoveDistanceToTrade) { 
this .fadeTheMoveDistanceToTrade = fadeTheMoveDistanceToTrade; 


} 


public int getFadeTheMovePipsDesired() { 
return fadeTheMovePipsDesired; 


} 


public void setFadeTheMovePipsDesired(int fadeTheMovePipsDesired) { 
this. fadeTheMovePipsDesired = fadeTheMovePipsDesired; 


} 
} 


public class BaseTradingConfig { 
private double minReserveRatio; 
private double minAmountRequired; 


private int maxAllowedQuantity; 
private int maxAllowedNetContracts; 
private double max10yrWma0ffset; 


public double getMinAmountRequired() { 
return minAmountRequired; 


} 


public void setMinAmountRequired(double minAmountRequired) { 
this.minAmountRequired = minAmountRequired; 


} 


public double getMax10yrwWmaOffset() { 
return max10yrWmaOffset ; 


} 


public void setMax10yrWmaO0ffset (double max10yrWma0ffset) { 
this .max10yrWmaOffset = max1oyrWmaOffset ; 


} 


public int getMaxAllowedNetContracts() { 
return maxAllowedNetContracts; 


} 
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79 public void setMaxAllowedNetContracts(int maxAllowedNetContracts) { 
80 this.maxAllowedNetContracts = maxAllowedNetContracts; 


81 } 

82 

83 public double getMinReserveRatio() { 

84 return minReserveRatio; 

ae 

86 

87 public void setMinReserveRatio(double minReserveRatio) { 
88 this.minReserveRatio = minReserveRatio; 
89 }S 

90 

91 public int getMaxAllowedQuantity() { 

92 return maxAllowedQuantity; 

93 =} 


Some of these member variables may not make sense now, but all will fall into place 
in later chapters. 


Obtaining the Source Code 


All source code can be obtained at GitHub. The following git command will clone the 
repository locally on your machine: 


1 git clone https://github.com/shekharvarshney/book-code.git 


We will discuss how this code can be built and run locally in later chapters. 


Try It Yourself Section 


At the end of each chapter, we include a small program/programs (wherever appropriate) 
that demonstrate the concepts discussed in the chapter and for you to experiment 
and see the concepts in action straightaway. These small standalone programs are 
for demonstration purposes only and may not be part of the code that runs the bot 
eventually. This is to get a flavor of things that make up a component of the bot. 

We will run these programs inside the eclipse IDE so that, if need be, you can debug 
and see what is happening inside the services used in the bot. These programs reside in 
a separate project called tradingbot-demo- programs, whose pom. xml file looks like the 
following 


1 <project xmlns="http://maven.apache.org/POM/4.0.0" 

2 xmlns:xsi="http: //www.w3.org/2001/XMLSchema-instance" 
3 xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
4 http://maven.apache.org/xsd/maven-4.0.0.xsd"> 
5 <modelVersion>4 .0.0</modelVersion> 

6 <groupId>com. precioustech</groupId> 
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7 <artifactId>tradingbot-demo-programs</artifactId> 

8 <version>1.0</version> 

9 <properties> 

10 <project. build. sourceEncoding>UTF -8</project.build.sourceEncoding> 

11 <spring. framework.version>4.1.1.RELEASE</spring. framework. version> 

12 <spring. framework. social.version>1.1.0.RELEASE</spring. framework. 
social.version> 

13 </properties> 

14 <dependencies> 

15 <dependency> 

16 <groupId>com. precioustech</groupId> 

17 <artifactId>tradingbot-core</artifactId> 

18 <version>1.0</version> 

19 </dependency> 

20 <dependency> 

21 <groupId>com.precioustech. fxtrading</groupId> 

22 <artifactId>tradingbot-app</artifactId> 

23 <version>1.0</version> 

24 </dependency> 

25 <dependency> 

26 <groupId>com.precioustech</groupId> 

27 <artifactId>oanda-restapi</artifactId> 

28 <version>1.0</version> 

29 </dependency> 

30 

31 </dependencies> 


32 «©</project> 


This demo project has a very simple dependency requirement on the three projects 
that comprise the bot. 
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Account Management 


The ability to manage the account is probably the first thing we need to build into our bot. 
When you open a trading account with a brokerage/exchange, an account is created that 
can be funded directly by bank transfer, credit card, PayPal, etc. An account has a base 
currency, which is normally the currency of the funding source. For example, if you are 
based in the UK and have an account with one of the UK banks used to fund the trading 
account, then the trading account will have a base currency of GBP (British pounds). 
However, some platforms give you the option to create other currency accounts, 
even though you may not have a funding source set up for them. For example, after 
being assigned a GBP account as a result of funding from UK bank, you can create an 
additional USD (U.S. dollars) account, even if you don’t have a USD funding source. The 
USD account can be funded however by transferring an amount of GBP from the main 
account, effectively selling GBPUSD. This exercise can be repeated for other currency 
accounts like CAD, EUR, etc. 
All accounts on most brokerage platforms, have the following attributes that can be 
queried: 
e  Anaccount ID 
e _ Base currency 
e Total amount 
e Balance remaining to trade 


e = Leverage 


Other optional information might include: 
e = Realized PNL 
e Unrealized PNL 
e =©Margin used 
e Open trades 


e Open orders 
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We begin by capturing all this information and creating an account POJO. Listing 2-1 


shows how to provide two constructors, one with minimum attributes required to construct 
the object based on this discussion. 


Listing 2-1. Definition of Account POJO 


1 
2 
3 
4 
5 
6 
7 
8 
9 


10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 


22 


23 
24 
25 


26 
27 


28 
29 
30 


31 


32 
33 
34 
35 
36 
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/** 

* A POJO that holds account information. No setters are provided as 
it is envisaged that the final member variables will be initialized 
through the constructor(s). 


* 

* 

* 

* @param <T> 

* the type of accountId 
*/ 

public class Account < T > { 


private final double totalBalance; 

private final double unrealisedPn1; 

private final double realisedPnl; 

private final double marginUsed; 

private final double marginAvailable; 

private final double netAssetValue; 

private final long openTrades; 

private final String currency; 

private final T accountId; 

private final String toStr; 

private final double amountAvailableRatio; /*The amount available to 
trade as a fraction of total amount*/ 

private final double marginRate; /*The leverage offered on this 
account. for e.g. 0.05, 0.1 etc*/ 

private final int hash; 


public Account(final double totalBalance, double marginAvailable, 
String currency, 

T accountId, double marginRate) { 

this(totalBalance, 0, 0, 0, marginAvailable, 0, currency, accountId, 
marginRate) ; 


} 


public Account(final double totalBalance, double unrealisedPnl, 
double realisedPnl, 

double marginUsed, double marginAvailable, long openTrades, String 
currency, 

T accountId, double marginRate) { 

this.totalBalance = totalBalance; 

this.unrealisedPnl = unrealisedPnl; 

this.realisedPnl = realisedPnl; 

this.marginUsed = marginUsed; 
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37 this.marginAvailable = marginAvailable; 

38 this.openTrades = openTrades; 

39 this.currency = currency; 

40 this.accountId = accountId; 

41 this.amountAvailableRatio = this.marginAvailable / this. 
totalBalance; 

42 this.netAssetValue = this.marginUsed + this.marginAvailable; 

43 this.marginRate = marginRate; 

44 this.hash = calcHashCode(); 

45 //Create toString here as all variables are final 


46 toStr = String. format ("Currency=%s ,NAV=%5.2f, Total Balance=%5.2f, 
UnrealisedPnl=%5.2f, " + "RealisedPnl=%5.2f, MarginU\ 

47 sed=%5.2f, MarginAvailable=%5.2f," + " OpenTrades=%d, 
amountAvailableRatio=%1.2f, marginRate=%1.2f", currency, 


48 netAssetValue, totalBalance, unrealisedPnl, realisedPnl, 
marginUsed, marginAvailable, 

49 openTrades, this.amountAvailableRatio, this.marginRate) ; 

50 } 

51 

52 public double getAmountAvailableRatio() { 

53 return amountAvailableRatio; 

54} 

55 

56 public double getMarginRate() { 

57 return marginRate; 

58 } 

59 


60 @O0verride 
61 public String toString() { 


62 return this. toStr; 

63 =} 

64 

65 public T getAccountId() { 

66 return accountId; 

67. 

68 

69 public String getCurrency() { 

70 return currency; 

71 } 

72 

73 public double getNetAssetValue() { 
74 return this.netAssetValue; 

1. 

76 

77 public double getTotalBalance() { 
78 return totalBalance; 

79 } 

80 
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81 public double getUnrealisedPnl() { 


82 return unrealisedPn1; 

83 } 

84 

85 public double getRealisedPnl() { 
86 return realisedPnl; 

87 } 

88 

89 public double getMarginUsed() { 
90 return marginUsed; 

91 } 

92 


93 @Override 

94 public int hashCode() { 

95 return this.hash; 

96 «+ 

97 

98 private int calcHashCode() { 
99 final int prime = 31; 


100 int result = 1; 

101 result = prime * result + ((accountId == null) ? 0 : accountId. 
hashCode()); 

102 return result; 

103} 

104 


105 @Override 
106 public boolean equals(Object obj) { 
107 if (this == obj) 


108 return true; 

109 if (obj == null) 

110 return false; 

111 if (getClass() != obj.getClass()) 
112 return false; 

113 @SuppressWarnings ("unchecked") 


114 Account < T > other = (Account < T > ) obj; 
115 if (accountId == null) { 


116 if (other.accountId != null) 

117 return false; 

118 } else if (!accountId.equals(other.accountId) ) 
119 return false; 

120 return true; 

121 } 

122 

123 public double getMarginAvailable() { 
124 return marginAvailable; 

125} 

126 
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127 public long getOpenTrades() { 
128 return openTrades; 

129 } 

130 

131} 


Looking at Listing 2-1, we can do a couple of small optimizations. All member 
variables are final, which means they are immutable. We can therefore calculate the 
hashCode() and toString() values upfront in the constructors and store them in final 
variables. Any call to toString() or hashCode() will return the pre-calculated values. 


Account Provider Interface 


We now need to specify our account data interface that defines what we expect our provider 
(aka implementation) to provide. We would not be interested in doing any account updates 
such as changing the leverage etc. but just interested in read-only information. Therefore, 
we require the provider to either give us a collection of all accounts or an account if the 
accountid is provided. Our interface would look something like Listing 2-2. 


Listing 2-2. AccountDataProvider Interface Definition 


1 /** 

2 * A provider of Account information. An account information might 

3 * typically include base currency, leverage, margin available, PNL 
4 * information etc. Some brokerages allow the creation of various sub 
5 * accounts or currency wallets. The idea is to give ability to fund 
6 * these accounts from various currency denominated bank accounts. 

7 * So for e.g. a user in Switzerland might have a CHF current account 
8 * but also a EUR savings account. One can then open 2 currency 

9 * accounts or wallets on the brokerage, denominated in CHF and EUR 
10 * and these can then be funded by the real bank accounts. 

11 * Alternatively, one can also just create these multiple currency 
12 * wallets even if they have just a single source funding currency. 
13 * When the primary account is funded, a transfer trade can be 

14 * executed to fund the other currency wallet. For e.g. a user in 

15 * United Kingdom who just has a GBP account, can open a USD 

16 * wallet, fund the GBP account and then execute a transfer of a 

17 * given units of GBP into USD. 

15 * 

16 * @param <T> 

17 ba The type of accountId 

18 = 

19 * @see Account 

20 */ 
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21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 


public interface AccountDataProvider < T > { 


/** 
* 

* @param accountId 

* @return Account information for the given accountId 
*/ 

Account < T > getLatestAccountInfo(T accountId) ; 


/** 

* 

* @return A collection of ALL accounts available 
*/ 

Collection < Account < T >> getLatestAccountInfo(); 


} 


This interface is pretty straightforward. We are just interested in a single account or a 


collection of accounts. We will see later in this chapter how this can be used in a service to 
do some advanced account-related operations/calculations. 


A Concrete Implementation for 
AccountDataProvider 


Our next task is to provide an OANDA implementation that achieves this. We begin by 
first statically importing all the relevant JSON keys that we expect to find in our payload. A 
sample response returned for account 123456 would look something like Listing 2-3. 


Listing 2-3. Sample JSON Payload for an Account 


= 
COON DU BWN BF 


= 
BR 


= 
Ww 
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{ 
"accountId" : 123456, 
"accountName" : "main", 
"balance" : 20567.9, 
"unrealizedPl" : -897.1, 
"yealizedPl" : 1123.65, 
"marginUsed" : 89.98, 
"marginAvail" : 645.3, 
"openTrades” : 5, 
"openOrders” : 0, 
"marginRate" : 0.05, 
"accountCurrency" : "CHF" 
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Listing 2-4. Import JSON Keys Statically 


1 


1 


import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
accountCurrency; 

import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
accountId; 

import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
balance; 

import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
marginAvail; 

import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
marginRate; 

import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
marginUsed; 

import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
openTrades; 

import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
realizedP1; 

import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
unrealizedP1; 


Since the OANDA account ID is a long, substituting long for T becomes 


public class OandaAccountDataProviderService implements 


AccountDataProvider<Long> { 


We provide the OANDA URL, the username and access token in the constructor, 


which looks like Listing 2-5. 


Listing 2-5. Constructor Definition 


MW PWN BP 


Oo CON DD 


10 


private final String url; 
private final String userName; 
private final BasicHeader authHeader; 


public OandaAccountDataProviderService(final String url, final String 
userName, 

final String accessToken) { 

this.url = url; //OANDA REST service base url 

this.userName = userName; //OANDA account user name 

this.authHeader = OandaUtils.createAuthHeader(accessToken) ; 


} 
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We now turn our attention to first of the implementations of the interface, which is to 
get information for a single account ID provided. Before we get to that, we must prepare 
the URL to send across to OANDA. The REST request must go to the ACCOUNTS_RESOURCE, 
which is defined as follows: 


1 public static final String ACCOUNTS RESOURCE = "/v1/accounts"; 


Therefore our function to construct the full URL to get account information would 
look like this: 


1 String getSingleAccountUrl(Long accountId) { 
2 return url + ACCOUNTS RESOURCE + TradingConstants.FWD SLASH + 
accountId; 


3 5 


If we pass account ID 123456 to this function and, assuming the base URL is https: // 
api-fxtrade.oanda.com, then this function would return https: //api-fxtrade.oanda. 
com/v1/accounts/123456. Getting back to the implementation of the method that 
retrieves information for a single account, which would look something like Listing 2-6. 


Listing 2-6. Single Account Fetch Implementation 


1 @Override 

2 public Account < Long > getLatestAccountInfo(final Long accountId) { 

3 CloseableHttpClient httpClient = getHttpClient(); 

4 try { 

5 return getLatestAccountInfo(accountId, httpClient) ; 

6 } finally { 

7 TradingUtils.closeSilently(httpClient) ; 

8 4} 

9 

10 

11 

12 private Account < Long > getLatestAccountInfo(final Long accountId, 
CloseableHttpClient httpClient) { 

13 try { 

14 HttpUriRequest httpGet = new HttpGet (getSingleAccountUrl1(accountId)) ; 

15 httpGet . setHeader(authHeader) ; 

16 

17 LOG. info(TradingUtils.executingRequestMsg(httpGet) ) ; 

18 HttpResponse httpResponse = httpClient.execute(httpGet) ; 

19 String strResp = TradingUtils.responseToString(httpResponse) ; 

20 if (strResp != StringUtils.EMPTY) { 

21 Object obj = JSONValue.parse(strResp) ; 

22 JSONObject accountJson = (JSONObject) obj; 

23 
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24 /*Parse JSON response for account information*/ 

25 final double accountBalance = ((Number) accountJson.get(balance)). 
doubleValue(); 

26 final double accountUnrealizedPnl = 

27 ((Number) accountJson.get(unrealizedP1)) .doubleValue() ; 

28 final double accountRealizedPnl = 

29 ((Number) accountJson.get(realizedP1)).doubleValue(); 

30 final double accountMarginUsed = 

31 ((Number) accountJson.get(marginUsed) ).doubleValue() ; 

32 final double accountMarginAvailable = 

33 ((Number) accountJson.get(marginAvail)) .doubleValue(); 

34 final Long accountOpenTrades = (Long) accountJson.get(openTrades) ; 

35 final String accountBaseCurrency = (String) accountJson. 
get (accountCurrency) ; 

36 final Double accountLeverage = (Double) accountJson.get(marginRate) ; 

37 

38 Account < Long > accountInfo = mew Account < Long > (accountBalance, 
accountUnrealizedPnl, 

39 accountRealizedPnl, accountMarginUsed, accountMarginAvailable, 
accountOpenTrades, 

40 accountBaseCurrency, accountId, accountLeverage) ; 

41 return accountInfo; 

42 } else { 

43 TradingUtils.printErrorMsg(httpResponse) ; 

44 } 


45 } catch (Exception e) { 
46 LOG.error(e); 


47 } 
48 return null; 
49 } 


The public method actually delegates to a private method where the main action 
happens. The processing starts by invoking the getSingleAccountUr1() method to 
prepare the URL to be sent to the OANDA REST API. We then instantiate an HttpGet 
request providing the URL to fetch information from. Before we trigger the request, we 
must not forget to set the authentication header without which the request will not be 
successful. After httpGet . setHeader (authHeader ), we are now set to make the request. 
Using the httpClient object, we can now fire off our GET request. If HTTP 200 is returned 
and TradingUtils.responseToString is able to convert the response to String, we should 
now have a valid JSON string payload something similar to Listing 2-3. Now all that is left 
is to parse this payload and construct the account POJO. You may be wondering why, in 
this peculiar code: 


1 inal double accountBalance = ((Number) accountJson.get(balance)). 
doubleValue(); 
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Why do we have the cast this to a Number object and then call doubleValue() instead 
of just casting to the Double object? The answer is that for some keys, which are presumed 
double, if the value is a whole number, the JSON response will not have a decimal value; 
instead it will have a Long. So for example, let’s say that the account balance is at a given 
time 3000.00. The value in the response will be something like this: 


1 "balance" : 3000 


The cast to Double directly will fail with a ClassCastException, hence we use this 
workaround to circumvent this subtlety in parsing. 

We must now provide an implementation for getting a collection of available 
accounts as per the interface contract. 


Listing 2-7. Fetch All Accounts Implementation 


1 @Override 

2 public Collection < Account < Long >> getLatestAccountInfo() { 
3 CloseableHttpClient httpClient = getHttpClient(); 

4 List < Account < Long >> accInfos = Lists.newArrayList(); 

5 try { 

6 HttpUriRequest httpGet = new HttpGet(getAllAccountsUr1()); 

7 httpGet . setHeader (this. authHeader) ; 

8 

9 

0 


LOG. info(TradingUtils.executingRequestMsg(httpGet) ) ; 


1 HttpResponse resp = httpClient.execute(httpGet) ; 

11 String strResp = TradingUtils.responseToString(resp) ; 

12 if (strResp != StringUtils.EMPTY) { 

13 Object jsonObject = JSONValue.parse(strResp) ; 

14 JSONObject jsonResp = (JSONObject) jsonObject; 

15 JSONArray accounts = (JSONArray) jsonResp.get(OandaJsonKeys. 
accounts); 

16 i 

17 * We are doing a per account json request because not all 

18 information is returned in the array of results 

19 */ 

20 for (Object 0: accounts) { 

21 JSONObject account = (JSONObject) 0; 

22 Long accountIdentifier = (Long) account.get(accountId) ; 

23 Account < Long > accountInfo = getLatestAccountInfo 

(accountIdentifier, httpClient) ; 

24 accInfos.add(accountInfo) ; 

25 } 

26 } else { 

27 TradingUtils.printErrorMsg (resp) ; 

28 } 

29 
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30 } catch (Exception e) { 

31 LOG.error(e); 

32 } finally { 

33 TradingUtils.closeSilently(httpClient) ; 


34S 
35 return accInfos; 
36} 


The OANDA REST API has an endpoint to retrieve all account information in a single 
request: 


1. GET vi/accounts 


However, looking at Listing 2-7, we still call the function that provides all account 
information for a single account iteratively. Why do we do this? The reason is that when 
we request information for all accounts using the endpoint v1/accounts, OANDA does 
not provide all information we need to construct our account POJO, as is evident from 
this response: 


, 4 

2 "accounts": [ 

3 { 

4 "accountId" : 1234567, 

5 "accountName" : "Primary", 
6 "accountCurrency" : "GBP", 
7 "marginRate" : 0.05 

8 }, 

9 { 

10 "accountId" : 2345678, 

11 "accountName" : "EUR Account", 
12 "accountCurrency" : "EUR", 
13 "marginRate" : 0.1 

14 } 

15 ] 

16 =} 


Encapsulating Everything Behind a Generic 
AccountinfoService 


As previously discussed, one of our key design objectives is to be able to encapsulate 
providers behind meaningful services so that if required, we can switch provider 
implementations and change from provider OANDA to say provider LMAX without 
having to change a single line of compiled code. Changes in the Spring configuration will 
hopefully help us make this transition smoothly. AccountInfoService, in addition to 
providing a facade for all the AccountDataProvider methods, has three additional useful 
methods: 
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NOW 


public Collection<K> findAccountsToTrade() ; 


public double calculateMarginForTrade(K accountId, 
TradeableInstrument<N> 


instrument, int units); 


public double calculateMarginForTrade(Account<K> accountInfo, 
TradeableInstrument<N> instrument, int units); 


Before discussing these, let’s quickly glance over the constructor that defines the 


dependencies of the service. 


Au PWN PR 
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* @param <K> 


type of accountId 


* @param <N> 


type of The type of instrumentId in class 
TradeableInstrument 


* @see TradeableInstrument 


public class AccountInfoService<K, N> { 


private final AccountDataProvider<K> accountDataProvider; 
private final BaseTradingConfig baseTradingConfig; 

private final CurrentPriceInfoProvider<N> 
currentPriceInfoProvider; 

private final ProviderHelper providerHelper; 

private Comparator<Account<K>> accountComparator = new MarginAv 
ailableComparator<K>(); 


public AccountInfoService(AccountDataProvider<K> 
accountDataProvider , 
CurrentPriceInfoProvider<N> currentPriceInfoProvider, 
BaseTradingConfig baseTradingConfig, ProviderHelper 
providerHelper) { 
this.accountDataProvider = accountDataProvider; 
this.baseTradingConfig = baseTradingConfig; 
this. currentPriceInfoProvider = 
currentPriceInfoProvider; 
this.providerHelper = providerHelper; 


} 


AccountDataProvider is the obvious one, as the service needs to 
be able to provide information for an individual account ID and 
all available accounts. 


CurrentPriceInfoProvider is a provider of current prices for a 
given set of instruments and will be discussed in later chapters. 
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e BaseTradingConfig, as discussed earlier, is an object that holds 
all the configuration parameters. 


e ProviderHelper, also discussed previously, provides helper 
methods to deal with provider related data transformations. 


We now turn our attention to the discussion of the findAccountsToTrade() method. 
As the name suggests, this method tries to find available accounts to trade, given certain 
conditions are met. Often, before placing a trade/order, the first exercise is to find a 
suitable account. Of course, this discussion does not apply to platforms where there 
is only a single account to trade, because all trades executed by default belong to this 
account. 


1 public Collection < K > findAccountsToTrade() { 

2 List < Account < K >> accounts = Lists.newArrayList(getAllAccounts()); 

3 Collection < K > accountsFound = Lists.newArrayList(); 

4 Collections.sort(accounts, accountComparator) ; 

5 for (Account < K > account: accounts) { 

6 if (account.getAmountAvailableRatio() >= baseTradingConfig. 
getMinReserveRatio() && account.getNetAssetValue() >= baseT\ 

7 xradingConfig.getMinAmountRequired()) { 

8 accountsFound.add(account.getAccountId()); 

9 } 

10 } 

11 return accountsFound; 

12. +} 


The method first fetches all available accounts by calling getAllAccounts(), which 
just delegates to the accountProvider: 


1 public Collection<Account<K>> getAllAccounts() { 
2 return this.accountDataProvider.getLatestAccountInfo() ; 


3 } 


Next, it tries to sort the accounts available, in decreasing order of margin availability 
using the MarginAvailableComparator. This comparator places the account with 
the maximum margin at the top of list and so on. The idea is to pick the account with 
maximum margin available. Of course, this is just a strategy to find an account when 
the accounts with denominated currencies are comparable in exchange rates. For 
example, if you have three accounts denominated in currencies CHF, EUR, USD, then this 
works because EURCHF ~= 1.08, USDCHF ~=1.0, and EURUSD ~= 1.0 (rates at the time 
of writing). This should fulfill the strategy of the account with the maximum available 
margin; however, it will fail miserably, if for example, one of the currencies is JPY instead 
of EUR. Since CHFJPY and USDJPY at the time of writing ~= 122.0, this is not ideal as most 
of the time the JPY account will be picked. 
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1 static class MarginAvailableComparator < K > implements Comparator < 
Account < K >> { 


2 

3 @O0verride 

4 public int compare(Account < K > ait, Account < K > ai2) { 
5 if (ai1.getMarginAvailable() > ai2.getMarginAvailable()) { 
6 return -1; 

7 } else if (ai1.getMarginAvailable() < ai2.getMarginAvailable()) { 
8 return 1; 

9 } 

10 return 0; 

11 } 

12 

13} 


Next, the account is selected to place an order/trade only if the following condition 
is met: 


1 if (account.getAmountAvailableRatio() >= baseTradingConfig. 
getMinReserveRatio() 

2 && account.getNetAssetValue() >= baseTradingConfig. 
getMinAmountRequired()) { 

accountsFound.add(account.getAccountId()); 


w 


4 } 
Assuming that 


1  minReserveRatio=0.2 
2 minAmountRequired=50.0 


A minimum reserve ratio of 0.2 is a metric that stipulates that ifa GBP account 
has total amount of £1000, then we must only select this account to trade if the amount 
available to trade > 0.2 x £1000(£200). I would strongly recommend having this validation 
in place, simply because this leaves the account with a decent buffer and prevents the 
NAV going negative, in case of wild swings in prices. This ought to be a higher value if the 
account leverage is quite high, say 1:50. 

The minimum amount required is a metric that stipulates that an account must have 
a minimum net asset value to be considered for trading. In this case, we must have at 
least £50 in NAV to be eligible to trade. 

Next we discuss the two overloaded methods calculateMarginForTrade. As the 
name suggests, these methods calculate the margin requirement for a given trade/order. 
These methods prove very useful in situations where we want to place bulk orders for 
various instruments and want to get an idea of margin requirements for them. These 
methods are also used a prevalidation check before sending the order to the platform, 
making sure that margin requirement for the given order is less than the amount 
available. 
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/* 
* ({BASE} / {Home Currency}) * units) / (margin ratio) 
For example, suppose: 
Home Currency = USD 
Currency Pair = GBP/CHF 
Base = GBP; Quote = CHF 
Base / Home Currency = GBP/USD = 1.5819 
Units = 1000 
Margin Ratio = 20:1 
Then, margin used: 
(1.5819 * 1000) / 20 
79.095 USD 


*/ 
@SuppressWarnings ("unchecked") 
public double calculateMarginForTrade(Account < K > accountInfo, 
TradeableInstrument < N > instrument, int units) { 

String tokens[] = TradingUtils.splitInstrumentPair(instrument. 
getInstrument()); 

String baseCurrency = tokens[0]; 

double price = 1.0; 


if (!baseCurrency.equals(accountInfo.getCurrency())) { 
String currencyPair = this.providerHelper.fromIsoFormat(baseCurrency + 
accountInfo.getCurrency()); 


Map < TradeableInstrument < N > , Price < N >> priceInfoMap = this. 
currentPriceInfoProvider 

.getCurrentPricesForInstruments(Lists.newArrayList ( 

new TradeableInstrument < N > (currencyPair))); 
if (priceInfoMap.isEmpty()) { /*this means we got the currency pair 
inverted*/ 

/*example when the home currency is GBP and instrument is USDJPY*/ 
currencyPair = this.providerHelper. fromIsoFormat ( 

accountInfo.getCurrency() + baseCurrency) ; 

priceInfoMap = this. currentPriceInfoProvider.getCurrentPricesForInst 
ruments (Lists 

-newArrayList(new TradeableInstrument < N > (currencyPair))); 

if (priceInfoMap.isEmpty()) { // something else is wrong here 

return Double.MAX_VALUE; 

} 

Price < N > priceInfo = priceInfoMap.values().iterator().next(); 

/*take avg of bid and ask prices*/ 

price = 1.0 / ((priceInfo.getBidPrice() + priceInfo.getAskPrice()) / 
2.0); 

} else { 

Price < N > priceInfo = priceInfoMap.values().iterator().next(); 
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40 /*take avg of bid and ask prices*/ 

41 price = (priceInfo.getBidPrice() + priceInfo.getAskPrice()) / 2.0; 

42 

43 

44 } 

45 return price * units * accountInfo.getMarginRate(); 

46} 

47 

48 public double calculateMarginForTrade(K accountId, TradeableInstrument 
< N > instrument, int units) { 

49 return calculateMarginForTrade(getAccountInfo(accountId), instrument, 
units); 

50} 


Before we discuss the logic in the method, let’s first highlight the variables that affect 
the calculations, which are: 


e The denominated or base currency (GBP in pair GBPUSD) 
e The quoted currency (USD in pair GBPUSD) 

e The account currency (e.g., CHF) 

e The margin rate or leverage (0.05 or 1:20) 


The easiest case is when the denominated currency is the same as the account 
currency. For example, if we want to place a buy order for 3000 units for instrument 
EURAUD and the account currency is EUR, then the calculation is 3000*0.05 = €150. The next 
case is where the base currency, quoted currency, and account currency are all different. 
Here we need to effectively get the current price for {BASE ccy}/{ACCOUNT ccy} and then 
multiply the price with units and margin rate. For example, if we want to buy 3000 units 
of GBPUSD and account currency is CHF, we need to effectively get the price of GBPCHF first 
and then do the rest of the multiplication. Assuming the GBPCHF price is 1.54, the margin 
requirement is 


1 double marginRequired = 1.54 * 3000 * 0.05 //231 CHF 

The last case is a derivative of the previous case with the difference being that the 
valid currency pair is {ACCOUNT ccy}/{BASE ccy}. In sucha case we have to divide the 
{ACCOUNT ccy}/{BASE ccy} price. Assuming we want to buy 3000 units of USDCHF and 
the account currency is GBP and the GBPUSD price is 1.53, then the margin required is 


1 double marginRequired = 3000 * 0.05/1.53 //98.03 GBP 


This service concludes our discussion of pretty much everything you need to learn 
about account management. 
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Try It Yourself 


In this section, we are going to create a demo program that will invoke some of the 
methods of AccountInfoService and print output to the console. See Figures 2-1 and 2-2. 
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package com.precioustech. fxtrading. account ; 
import java.util.Collection; 
import org.apache.log4j.Logger; 


import com.precioustech. fxtrading.BaseTradingConfig ; 

import com.precioustech. fxtrading.helper.ProviderHelper ; 

import com.precioustech. fxtrading. instrument. TradeableInstrument ; 
import com.precioustech. fxtrading.marketdata.CurrentPriceInfoProvider ; 
import com.precioustech. fxtrading.oanda.restapi.account. 
OandaAccountDataProviderService ; 

import com.precioustech. fxtrading.oanda.restapi.helper. 
OandaProviderHelper ; 

import com.precioustech. fxtrading.oanda.restapi.marketdata. 
OandaCurrentPriceInfoProvider ; 


public class AccountInfoServiceDemo { 


private static final Logger LOG = Logger.getLogger (AccountInfoService 
Demo.class); 


private static void usage(String[] args) { 
if (args.length != 3) { 
LOG.error("Usage: AccountInfoServiceDemo <url> <username> 
<accesstoken>") ; 
System. exit(1); 
} 
} 


public static void main(String[] args) { 
usage(args) ; 

String url = args[0]; 

String userName = args[1]; 

String accessToken = args[2]; 


// initialise the dependencies 
AccountDataProvider < Long > accountDataProvider = new OandaAccountDa 
taProviderService(url, userName, 

accessToken) ; 
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CurrentPriceInfoProvider < String > currentPriceInfoProvider = new Oa 
ndaCurrentPriceInfoProvider(url, 

accessToken); 

BaseTradingConfig tradingConfig = new BaseTradingConfig(); 
tradingConfig.setMinReserveRatio(0.05); 
tradingConfig.setMinAmountRequired(100.00) ; 

ProviderHelper < String > providerHelper = new OandaProviderHelper(); 


AccountInfoService < Long, String > accountInfoService = new 
AccountInfoService < Long, String > ( 

accountDataProvider, 

currentPriceInfoProvider, tradingConfig, providerHelper) ; 


Collection < Account < Long >> accounts = accountInfoService. 
getAllAccounts(); 

LOG. info(String.format("Found %d accounts to trade for user %s", 
accounts.size(), userName) ); 

LOG. info("+++++++4+4+4++++4+4++4++4+4++4+4+4+++4+4+4+++ Dumping Account Info ++++++ 
FHEETHHt ttt ttt ttt ttt") 5 

for (Account < Long > account: accounts) { 

LOG. info(account) ; 


LOG. info("++++++++4+4++4++4+4++4+4+4++++ Finished Dumping Account Info ++++++ 
FHEEHHttttttttttttttttt " ) 5 
Account < Long > sampleAccount = accounts.iterator().next(); 
final int units = 5000; 
TradeableInstrument < String > gbpusd 
String > ("GBP_USD"); 
TradeableInstrument < String > eurgbp = new TradeableInstrument < 
String > ("EUR GBP"); 
double gbpusdMarginReqd = accountInfoService.calculateMarginForTrade( 
sampleAccount, gbpusd, units); 
double eurgbpMarginReqd = accountInfoService.calculateMarginForTrade( 
sampleAccount, eurgbp, units); 
LOG. info(String.format("Margin requirement for trading pair %d units 
of %s is %5.2f %s ", units, 
gbpusd.getInstrument(), gbpusdMarginReqd, sampleAccount. 
getCurrency())); 
LOG. info(String.format("Margin requirement for trading pair %d units 
of %s is %5.2f %s ", units, 
eurgbp.getInstrument(), eurgbpMarginReqd, sampleAccount. 
getCurrency())); 


new TradeableInstrument < 
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Name: AccountinfoServiceDemo 


Bi JRE) “; Classpath  y Source |B Environment 1 commen| 


hitps://api-fxtrade.canca.com SuaEEENey 
0 EE 


Variables... 


VM arguments: 


Variables... a 


© Use the -XstartOnFirstThread argument when launching with SWT 
Working directory: 

© Defauit: 

©) Other: 


cn) 


Figure 2-1. Launch configuration 


ctermnated> AccountintoServiceDome (Jave Appication| /L braryiJava/Java¥ rtuaMochnes/(de1.7.0,71.de/Contents/ome/bajave (26 J97 2016 19:65:46) 
2016-01-26 
2016-01-26 


146,445 INFO 
INFO 
Info 
Info 
Info 
INO 
INFO 
INFO 
INFO 


Executing request 
~ Executing request 
~ Executing request 
Kxecuting request 
Kxecuting request 
Executing request 
Executing request 
Found 6 eccounts to 


GET httes://epi- frtrede.cande.com/vi/accounts usermane-cvershney HTTP/1.2 
GET https: //opi-fxtrede.conde.com/vi/accounts/Atite HTTP/3.1 

GET https://opi-Fatrede.conde.com/vi/accounts/ @eRRPRRHTTP/1.1 

https: //epi-Fxtrode. conde. com/vi/eccounts/ SORE NITP/2.1 

GET https: //epi-Frtrede conde. com/vi/accounts/ MOORRRHTTP/3.2 

GET https: //epi-Frtrede conde. com/vi/accounts/OO00® HTTP/3.2 
/1ep\-tntrede conde .com/vi/accounts/ARPOP TTP/3.2 

user 

+ umping Account Info 


§ 


teeesees 
Reol isedPnl~ 7B, MorginUsed-1101.97, MerginAvel Loble~7ihbet! 


SSSSsssssssss 
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8,688 INFO | Relonce=Samemth, Unreal ised 

18,689 INFO Bolence= 0.09, UnreclisecPnl~ 0.20, ReolisedPnl PER, Morgintised= 0.08, Morgintvoiloble= 0.08, OpenTre 
8,689 INFO 1 Rolence-S988R®, Unreal isedPnl~ }, Real \sedPnl~82.06, MorginUsed-186. 98, Morgindve\loble-FRT™, Of 
48,689 INFO CurrencyeUS0,NAV= 8.61, Total Bolence= 0.01, UnreolisedPnl= 0.28, RealisedPni= 0.08, MorginUsed= @.0@, MarginAvailedle= 0.01, OperTroc 
48,689 INFO ee a ee Roo! (sedPo arms. Mor, clsed nm, Morgindval lableai4?! 
48,689 INFO CurrencyeCAb Mave @.08,Total Balence= 0.08, Unreo! isedPal. | RealisedPnl= @.00, MorginUsed= 0.00, MarginAvailable= 0.08, OpenTroc 
48,689 INFO teeceeeeececeseesceess Finished Dumping Account Info sess+es: 

48,755 INFO Executing request : GET httes://< 

49,323 INFO Executing request : GET httos://opi-fxtrode anda. com/vi/prices?instruments-CUR_CHF HTTP/1. Hi 

49,792 INFO [moin) - Merging requirement for troding pair 5088 units of GEP_USD is 365.45 CHF 

49,793 INFO [mein] - Merging requirement for troding peir 5088 units of CUR_GEP is 276.21 CHF 


Figure 2-2. Sample output 
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Tradeable Instruments 


In this chapter we will focus our attention on instruments available to trade on the 
brokerage platform. The instrument entity is pretty much the core of a trading platform, 
as everything revolves around it. From obtaining prices, to placing orders/trades, the 
instrument is what is the principal actor. Before much further ado, let’s dive into the 
POJO, which describes the tradeable instrument. 


Listing 3-1. TradeableInstrument POJO Definition 


1 /** 
2 * 
3 * @param <T> 
4 the type of instrumentId 
5 */ 
6 public class TradeableInstrument < T > { 
7 private final String instrument; 
8 private final String description; 
9 private final T instrumentId; 
10 private final double pip; 
11 private final int hash; 
12 private InstrumentPairInterestRate instrumentPairInterestRate; 
13 
14 public TradeableInstrument(String instrument) { 
15 this(instrument, null); 
16 } 
17 
18 public TradeableInstrument(String instrument, String description) { 
19 this(instrument, null, description) ; 
20 } 
21 
22 public TradeableInstrument(String instrument, T instrumentId, String 
description) { 
23 this(instrument, instrumentId, 0, null); 
24 } 
25 
© Shekhar Varshney 2016 47 
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public TradeableInstrument(final String instrument, final double pip, 
InstrumentPairInterestRate instrumentPairInterestRate, String 
description) { 

this(instrument, null, pip, instrumentPairInterestRate, description); 


} 


public TradeableInstrument (final String instrument, T instrumentId, 
final double pip, 

InstrumentPairInterestRate instrumentPairInterestRate) { 
this(instrument, instrumentId, pip, instrumentPairInterestRate, null); 


} 


public TradeableInstrument (final String instrument, T instrumentId, 
final double pip, 

InstrumentPairInterestRate instrumentPairInterestRate, String 
description) { 

this.instrument = instrument; 

this.pip = pip; 

this.instrumentPairInterestRate = instrumentPairInterestRate; 
this.instrumentId = instrumentId; 

this.description = description; 

this.hash = calcHashCode(); 


private int calcHashCode() { 

final int prime = 31; 

int result = 1; 

result = prime * result + ((instrument == null) ? 0 : instrument. 
hashCode()); 

result = prime * result + ((instrumentId == null) ? 0: 
instrumentId.hashCode()); 

return result; 


} 


public T getInstrumentId() { 
return this. instrumentId; 


} 


public String getDescription() { 
return description; 


} 


@Override 
public int hashCode() { 
return hash; 


} 


68 
69 
70 
71 
72 
73 
74 
75 
76 
77 
78 
719 
80 
81 
82 
83 
84 
85 
86 
87 
88 
89 
90 
91 
92 
93 
94 
95 
96 
97 
98 
99 


100 
101 
102 
103 
104 
105 


106 


107 
108 
109 
110 
111 
112 


CHAPTER 3 — TRADEABLE INSTRUMENTS 


@Override 
public boolean equals(Object obj) { 
if (this == obj) 
return true; 
if (obj == null) 
return false; 
if (getClass() != obj.getClass()) 
return false; 
@SuppressWarnings ("unchecked") 


TradeableInstrument < T > other = (TradeableInstrument < T > ) obj; 


if (instrument == null) { 
if (other.instrument != null) { 
return false; 
} 
} else if (!instrument.equals(other.instrument)) { 
return false; 
i 
if (instrumentId == null) { 
if (other.instrumentId != null) { 
return false; 
} 
} else if (!instrumentId.equals(other.instrumentId)) { 
return false; 
} 
return true; 


} 


public InstrumentPairInterestRate getInstrumentPairInterestRate() { 


return instrumentPairInterestRate; 


} 


public void setInstrumentPairInterestRate(InstrumentPairInterestRate 


instrumentPairInterestRate) { 
this. instrumentPairInterestRate = instrumentPairInterestRate; 


} 


@0verride 
public String toString() { 

return "TradeableInstrument [instrument=" + instrument + ", 
description="_+ description + ", instrumentId=" + instrume\ 
ntId + ", pip="+ pip +", instrumentPairInterestRate=" + 
instrumentPairInterestRate + "]"; 


} 


public String getInstrument() { 
return instrument; 


} 
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113 public double getPip() { 
114 return pip; 

115 

116} 


The TradeableInstrument definition is fairly straightforward but has a generic T 
parameter, to cater to different types of instrument IDs on different brokerage platforms. 
We also provide several constructors to construct our POJO. The minimum attribute 
required to construct our POJO is attribute instrument. 

The POJO comprises these attributes: 


private final String instrument; 

private final String description; 

private final T instrumentId; 

private final double pip; 

private InstrumentPairInterestRate instrumentPairInterestRate; 


WPWN PB 


The first two attributes are fairly self explanatory. Instrument ID represents an 
internal identifier for that instrument on the given platform. This may be required on 
some platforms to be passed in instead of the actual instrument code (like GBP_USD) for 
placing an order/trade. It, along with instrument attribute, participates in the definition 
of hashCode() and equals(). 

The pip’ is, as far as I understand, is the lowest precision at which the given 
instrument ticks. For example, the pip value for USDJPY is 0.001, which means the 
minimum change in price for USDJPY would be 0.001. If the current USDJPY price is 
123.462, then at minimum the next price change would be to either 123.461 or 123.463. 

The instrumentPairInterestRate is an interesting attribute that may or may not 
be available on all platforms. As seen in its definition, it can capture some important 
information like what the charges for a given instrument are likely to be, both in the cases 
of buying and selling it. The finance charge,’ in brief, is an amount of currency paid by 
brokerage platform or due to it, for holding a trade for given pair. For example, at the 
time of writing a certain amount will be due to the holder of long NZDCHF trade, but vice 
versa an amount liable for short NZDCHF trade. This value arises from the interest rate 
differentials of the two currencies in question (NZD base rate=3%, CHF base rate=0%). 


Listing 3-2. InstrumentPairInterestRate POJO Definition 


package com.precioustech. fxtrading. instrument ; 


public class InstrumentPairInterestRate { 


private final Double baseCurrencyAskInterestRate; 
private final Double quoteCurrencyBidInterestRate; 


1 
2 
3 
4 
5 private final Double baseCurrencyBidInterestRate; 
6 
7 
8 private final Double quoteCurrencyAskInterestRate; 
9 


‘http: //fxtrade.oanda.com/learn/intro-to-currency-trading/conventions/pips 
*http://fxtrade.oanda.ca/learn/intro-to-currency-trading/conventions/rollovers 
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10 public InstrumentPairInterestRate() { 
11 this(null, null, null, null); 


12 } 

13 

14 public InstrumentPairInterestRate(Double baseCurrencyBidInterestRate, 
15 Double baseCurrencyAskInterestRate, Double 


quoteCurrencyBidInterestRate, 
16 Double quoteCurrencyAskInterestRate) { 
17 this. baseCurrencyBidInterestRate = baseCurrencyBidInterestRate; 
18 this. baseCurrencyAskInterestRate = baseCurrencyAskInterestRate; 
19 this. quoteCurrencyBidInterestRate = quoteCurrencyBidInterestRate; 
20 this. quoteCurrencyAskInterestRate = quoteCurrencyAskInterestRate; 


23 public Double getBaseCurrencyBidInterestRate() { 
24 return baseCurrencyBidInterestRate; 
25} 


27 public Double getBaseCurrencyAskInterestRate() { 
28 return baseCurrencyAskInterestRate; 
29 } 


31 public Double getQuoteCurrencyBidInterestRate() { 
32 return quoteCurrencyBidInterestRate; 
ce 


35 public Double getQuoteCurrencyAskInterestRate() { 
36 return quoteCurrencyAskInterestRate; 
a7} 


39 @Override 

40 public String toString() { 

41 return "InstrumentPairInterestRate [baseCurrencyBidInterestRate=" + 
baseCurrencyBidInterestRate + ", baseCurrencyAskIn\ 

42 terestRate=" + baseCurrencyAskInterestRate + ", quoteCurrency 
BidInterestRate=" + quoteCurrencyBidInterestRate + ", quote\ 

43 CurrencyAskInterestRate=" + quoteCurrencyAskInterestRate + "]"; 

44 } 

45} 


Instrument Provider Interface 


We must now define the interface that the provider must implement to get instrument 
data. Like with the accounts, we are only interested in read-only data, as there is nothing 
that we can create, update, or delete regarding instruments on the brokerage platform. 
It is a very simple case of getting immutable data, which probably never changes, at 
least during trading hours. There may be rare occasions where certain instruments are 
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no longer supported, but most of the time, the observation is that new instruments are 
added to be traded. Something that might change more frequently but only during the 
rollover window is the interest rate for various currencies. As seen in Listing 3-3, the 
interface is extremely straightforward. 


Listing 3-3. InstrumentDataProvider Interface Definition 


1 j** 

2 * A provider of tradeable instrument data information. At the very 

3 * minimum the provider must provide the instrument name and pip 

4 * value for each instrument. Since the instrument data almost never 

5 * changes during trading hours, it is highly recommended that the 

6 * data returned from this provider is cached in an immutable 

7 * collection. 

8 * @param <T>The type of instrumentId in class TradeableInstrument 

9 * @see TradeableInstrument 

10 */ 

11 public interface InstrumentDataProvider < T > { 

12 [ee 

13 * 

14 * @return a collection of all TradeableInstrument available to trade 
on the 

15 * brokerage platform. 

16 */ 


17. Collection < TradeableInstrument < T >> getInstruments(); 
18 «=«+} 


A Concrete Implementation for 
InstrumentDataProvider 


Before we dive into detailed discussion of the OANDA implementation of the interface, 
let’s quickly look at an extract of sample JSON that is returned when we request a list of all 
tradeable instruments. The actual JSON would contain many instruments. 


Listing 3-4. Sample JSON Payload for Instruments 


: 
“instruments”: [ 
{ 

“instrument”: "AUD CAD", 

"pip": "0.0001", 

"interestRate": { 

"AUD": { 

"bid": 0.0164, 
"ask": 0.0274 


DO ON ADU BRWN BF 
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11 "CAD": { 

12 "bid": 0.002, 
13 "ask": 0.008 
14 } 

15 } 

16 }s 

17 { 

18 "instrument": "AUD CHF", 
19 "pip": "0.0001", 
20 “interestRate": { 
21 "AUD": { 

22 "bid": 0.0164, 
23 "ask": 0.0274 
24 }, 

25 "CHF": { 

26 "bid": -0.013, 
27 "ask": 0.003 
28 } 

29 } 

30 } 

31 ] 

32} 


As usual we begin our code discussion by listing all the JSON keys that will be used: 


1 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys.ask; 

2 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys.bid; 

3 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
instruments ; 

4 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
interestRate; 


Since OANDA currently does not have an internal identifier for an instrument, we use 
the instrument name as the identifier. So replacing the T param type with String gives us: 


1 public class OandaInstrumentDataProviderService implements 
InstrumentDataProvider<String> { 


For the constructor definition, we provide the OANDA URL, a valid account ID, and 
an access token. Please bear in mind that the account ID should be a valid account for the 
user associated with the access token. 


1 public OandaInstrumentDataProviderService(String url, long accountId, 
String accessToken) { 

this.url = url; // OANDA REST service base url 

this.accountId = accountId; // OANDA valid account id 
this.authHeader = OandaUtils.createAuthHeader(accessToken) ; 


} 


WPWN 
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The instruments resource endpoint is 
1 public static final String INSTRUMENTS RESOURCE = "/v1/instruments"; 


Therefore our function to compute the URL to get all tradeable instruments from 
OANDA would look like this: 


1 static final String fieldsRequested = "instrument%2Cpipz2CinterestRate" 
//URL encoded csv list of fields; 


String getInstrumentsUrl() { 
return this.url + OandaConstants. INSTRUMENTS RESOURCE + "?accountId=" + 
this.accountId + "&fields=" + fieldsRequested; 


} 


Aun BWN 


A note about the variable fieldsRequested. By default, if this request param is not 
part of the URL then OANDA returns by default fields instrument, displayName, pip, and 
maxTradeUnits, as seen in the following sample JSON response: 


1 { 

2 “instruments” : [ 

3 { 

4 "instrument" : "AUD CAD", 

5 "displayName" : "AUD\/CAD", 
6 "pip" : "0.0001", 

7 "maxTradeUnits" : 10000000 

8 }; 

9 { 

10 "instrument" : "AUD CHF", 
11 "displayName" : "AUD\/CHF", 
12 "pip" ; "0.0001", 

13 "maxTradeUnits" : 10000000 
14 } 

15 ] 

16} 


Since interestRate is not in the default field list, we have to explicitly request it 
using the fieldsRequested query param, along with every field that we want in the 
response. Now let’s move on to the main implementation of the interface, which looks 
like Listing 3-5. 


Listing 3-5. getInstruments() Implementation 


1 @Override 

2 public Collection < TradeableInstrument < String >> getInstruments() { 
Collection < TradeableInstrument < String >> instrumentsList = Lists. 
newArrayList(); 

4 CloseableHttpClient httpClient = getHttpClient(); 


w 
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try { 
HttpUriRequest httpGet = new HttpGet(getInstrumentsUr1()); 
httpGet . setHeader (authHeader) ; 
LOG. info(TradingUtils.executingRequestMsg(httpGet) ) ; 


HttpResponse resp = httpClient.execute(httpGet) ; 
String strResp = TradingUtils.responseToString(resp) ; 
if (strResp != StringUtils.EMPTY) { 


Object obj = JSONValue.parse(strResp) ; 
JSONObject jsonResp = (JSONObject) obj; 
JSONArray instrumentArray = (JSONArray) jsonResp.get(instruments) ; 


for (Object o: instrumentArray) { 
JSONObject instrumentJson = (JSONObject) 0; 
String instrument = (String) instrumentJson.get(OandaJsonkKeys. 
instrument) ; 
String[] currencies = OandaUtils.splitCcyPair(instrument) ; 
Double pip = Double.parseDouble(instrumentJson. get (OandaJsonKeys. 
pip).toString()); 
JSONObject interestRates = (JSONObject) instrumentJson. 
get(interestRate) ; 
if (interestRates.size() != 2) { 
throw new IllegalArgumentException(); 
} 


JSONObject currency1Json 
get(currencies[0]); 
JSONObject currency2Json = (JSONObject) interestRates. 
get(currencies[1]); 


(JSONObject) interestRates. 


final double baseCurrencyBidInterestRate = ((Number) currency1Json. 
get (bid) ).doubleValue(); 

final double baseCurrencyAskInterestRate 
get (ask) ).doubleValue() ; 

final double quoteCurrencyBidInterestRate = ((Number) 
currency2Json.get(bid)).doubleValue() ; 

final double quoteCurrencyAskInterestRate = ((Number) 
currency2Json.get(ask)).doubleValue() ; 


((Number) currency1Json. 


InstrumentPairInterestRate instrumentPairInterestRate = new 
InstrumentPairInterestRate( 

baseCurrencyBidInterestRate, baseCurrencyAskInterestRate, 
quoteCurrencyBidInterestRate, quoteCurrencyAskInterestRate) ; 


TradeableInstrument < String > tradeableInstrument = new 
TradeableInstrument < String > ( 

instrument, pip, instrumentPairInterestRate, null); 
instrumentsList.add(tradeableInstrument) ; 


} 
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42 } else { 

43 TradingUtils.printErrorMsg (resp) ; 

44 

45 } catch (Exception e) { 

46 LOG.error(e); 

47 } finally { 

48 TradingUtils.closeSilently(httpClient) ; 


49 } 
50 return instrumentsList; 
5a} 


The implementation is pretty straightforward and can be summarized as follows: 


e Construct the request URL by calling the getInstrumentUr1() 
function. 


e _- Fire off the request using an instance of the HttpGet class. 
e Asuccessful request will contain an array of instruments. 


e For each element in the array, parse the instrument, pip which is 
readily available in the element. The interestRate must further 
be treated as an array of two elements, the first one for the base 
currency and the second for the quoted currency. 


e Parse the bid/ask interest rate for each currency and create an 
instance of the InstrumentPair- InterestRate object. 


e Wenow have all the attributes we need for a given instrument. 
Store them in the collection that will be returned from this 
method. 


Encapsulating Everything Behind a Generic 
InstrumentService 


This service will provide some useful information regarding tradeable instruments, which 
we will soon explore. Since the instrument data is fairly immutable, we can safely cache 
the instrument information internally and then use the cache to service requests for any 
requested information. Since the cache is immutable and read-only, we do not have 

to worry about concurrency issues. We begin by discussing the constructor, which just 
needs an implementation of the InstrumentDataProvider as a dependency. 


1 private final Map<String, TradeableInstrument<T>> instrumentMap; 

2 

3. public InstrumentService(InstrumentDataProvider<T> 
instrumentDataProvider) { 

4 Preconditions. checkNotNull(instrumentDataProvider) ; 
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Collection<TradeableInstrument<T>> instruments = 

instrumentDataProvider.getInstruments(); 

Map<String, TradeableInstrument<T>> tradeableInstrumenMap = 

Maps .newHashMap() ; 

for (TradeableInstrument<T> instrument : instruments) { 
tradeableInstrumenMap. put (instrument.getInstrument(), 
instrument) ; 

} 

this.instrumentMap = Collections.unmodifiableMap 

(tradeableInstrumenMap) ; 


} 


Within the constructor, we use the InstrumentDataProvider implementation to 


fetch all instruments at once and then construct our immutable cache instrumentMap. 
We now turn our attention to discussing the first of our two service methods called 
getPipForInstrument. This returns the pip for a given instrument. A useful invocation for 
this method is to say calculate the stop loss or take profit price when placing a limit order 
for an instrument. Let’s say we want to place a limit buy order for EURUSD if the current 
price drops by 30 pips. Our trigger price would be something like this: 


1 


W ON DUM f 


TradeableInstrument<String> eurusd = new TradeableInstrument<String> 
("EUR_USD"); 

double triggerPrice = currentPrice - 30 * instrumentService.getPipForIn 
strument(eurusd) ; 


Now let’s look at the actual code for this useful service method. 


public Double getPipForInstrument(TradeableInstrument < T > instrument) 
{ 

Preconditions. checkNotNull(instrument) ; 

TradeableInstrument < T > tradeableInstrument = this.instrumentMap. 
get (instrument. getInstrument()); 

if (tradeableInstrument != null) { 

return tradeableInstrument.getPip(); 

} else { 

return 1.0; 

} 
i 


This code is quite straightforward. Using the instrument passed in, fetch the instance 


of TradeableInstrument that corresponds to the instrument. If it’s not found, return 1.0; 
otherwise, return the pip value for the instrument. 
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Another useful service method is getAl1PairsWithCurrency. This returns a 
collection of all instruments in which the given currency is either a denominated or 
quoted currency. For example, to get a collection of all instruments that have CHF as the 
base or quoted currency, you would invoke it as follows: 


1  //return instruments such as USDCHF,CHFIPY.. 
2 Collection<TradeableInstrument<String>> chfpairs = instrumentService.get 
AllPairsWithCurrency ("CHF"); 


Now let’s look at the actual implementation, which is again quite straightforward: 


1 public Collection < TradeableInstrument < T >> 
getAllPairsWithCurrency(String currency) { 

2 Collection < TradeableInstrument < T >> allPairs = Sets.newHashSet(); 

3 if (StringUtils.isEmpty(currency)) { 

4 return allPairs; 

= 

6 for (Map.Entry < String, TradeableInstrument < T >> entry: 

instrumentMap.entrySet()) { 

7 if (entry.getKey().contains(currency)) { 

8 allPairs.add(entry.getValue()); 

9 } 

10 } 

11 return allPairs; 

12. +} 


In this code, we return an empty collection if the passed-in value is null or a blank 
string. Ifit’s a valid string, we iterate over our cache and use contains to check if the 
current key contains the passed-in string. If it does, then we just add it to the collection 
that will be returned from the method. This concludes our discussion of pretty much 
most of the issues around tradable instruments. 


Try It Yourself 


In this section we are going to create a demo program that will invoke some of the 
methods of InstrumentServiceDemo and print output to the console: 


1 package com.precioustech. fxtrading. instrument ; 

2 

3 import java.util.Collection; 

4 

5 import org.apache.commons.lang3.StringUtils ; 

6 import org.apache.log4j.Logger; 

7 

8 import com.precioustech.fxtrading.oanda.restapi.instrument. 
OandaInstrumentDataProviderService ; 

9 

10 public class InstrumentServiceDemo { 

11 
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private static final Logger LOG = Logger. 
getLogger(InstrumentServiceDemo.class) ; 


private static void usageAndValidation(String[] args) { 
if (args.length != 3) { 
LOG.error("Usage: InstrumentServiceDemo <url> <accountid> 


<accesstoken>"); 
System.exit(1); 
} else { 


if (!StringUtils.isNumeric(args[1])) { 
LOG.error("Argument 2 should be numeric"); 


System.exit(1); 
} 
} 
} 


public static void main(String[] args) { 
usageAndValidation(args) ; 

String url = args[0]; 

Long accountId = Long.parseLong(args[1]); 
String accessToken 


= args[2]; 


InstrumentDataProvider < String > instrumentDataProvider = 
new OandaInstrumentDataProviderService(url, 
accountId, accessToken) ; 


InstrumentService < String > instrumentService = new 
InstrumentService < String > (instrumentDataProvider) ; 


Collection < TradeableInstrument < String >> gbpInstruments = 
instrumentService. getAl]PairsWithCurrency("GBP") ; 


LOG. info("++++++++++++4+4+4++++4++++4+4++4+4+4+4+++ Dumping Instrument Info +++ 

FHttt ttt ttt ttt ttt") 3 

for (TradeableInstrument < String > instrument: gbpInstruments) { 
LOG. info(instrument) ; 


} 


LOG. info("++++++++4+4++4+4+4+++4++4+++4+4+Finished Dumping Instrument Info +++ 
+ttttttttttttttttttttttttt") 5 

TradeableInstrument < String > euraud = new TradeableInstrument < 
String > ("EUR AUD"); 


TradeableInstrument < String > usdjpy 


new TradeableInstrument < 


String > ("USD JPY"); 
TradeableInstrument < String > usdzar = new TradeableInstrument < 
String > ("USD ZAR"); 


Double usdjpyPip 
Double euraudPip 


instrumentService. getPipForInstrument (usdjpy) ; 
instrumentService. getPipForInstrument (euraud) ; 
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51 Double usdzarPip = instrumentService.getPipForInstrument(usdzar) ; 


52 


53 LOG.info(String.format("Pip for instrument %s is %1.5f", euraud. 


getInstrument(), euraudPip)); 


54 LOG. info(String.format("Pip for instrument %s is %1.5f", usdjpy. 


getInstrument(), usdjpyPip)); 


55 LOG.info(String.format("Pip for instrument %s is %1.5f", usdzar. 


getInstrument(), usdzarPip)); 
56} 
57 
58} 


Name: InstrumentServiceDemo 


© main 9 Arguments = JRE | “> Classpath | iy Source & Environment | [7 common 


Program arguments: 


https://api-fxtrade.canda.com >a 
0 en nce AN RRR A I OLS LY ARNEL ILE AED ACETATE | 


VM arguments: 


Use the -XstartOnFirstThread argument when launching with SWT 


Working directory: 
© Default: 
Other: 


Variables... 


Variables... 


Figure 3-1. Launch configuration 
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Figure 3-2. Sample output 
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Event Streaming: Market 
Data Events 


Now we have reached the point where the true existence of the trading bot will start to 
become apparent. From here onward, we are going to step into the real aspects of trading, 
one of which is to handle realtime events and act on them, after meaningfully analyzing 
them. You could have event streams in the following shape and form: 


e Market data events, i.e., changes in the price of an instrument 
e = Trade/order/account events, i.e., orders filled or stop loss level hit 


e Social media events, i.e., tweets from influential people or market 
movers 


e Any other source 


As you can see, you can have numerous event streams, bombarding our trading bot 
with varying degrees of intensity. Handling them and making decisions based on them is 
the cornerstone of the trading bot design. In this chapter, we exclusively discuss how to 
handle market data events and how to disseminate them using the Google EventBus. 


Streaming Market Data Interface 


We begin by defining an interface that stipulates the minimum set of methods required 
for the market event streaming to work in our bot. On the face of it, it looks there 

is not much to it, as we just enforce a start and stop requirement on the interface 
implementer. However, as we will see later, when discussing the implementation, 

that part of the job of the implementer is to invoke a MarketEventCallback handler 
that processes the streaming market event received. The assumption is that the 
startMarketDataStreaming() establishes a continuous connection (event loop) to the 
event source, i.e. in a separate thread, and this thread receives market data events on 
that connection. The event is then parsed and passed on to MarketEventCallback to be 
processed further. 
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1 /** 

2 * A service that provides streaming market data. Normally the 

3 * implementation would create a dedicated connection to the trading 

4 * platform and would receive a stream of prices ideally through a 

5 * REST service or a callback from the platform. The implementation 

6 * must handle broken connections and attempt to reconnect in a 

7 * suitable manner. The service is normally coupled with a heartbeats 

8 * from the platform which indicates whether the connection is alive 

9 * 

10 * or not. Due to the volume of data expected, it is recommended that 

11 * the service delegate the handling of market data to another 

12 * service in order to avoid building up of queue of events, waiting to 

13 * be processed. 

14 */ 

15 public interface MarketDataStreamingService { 

16 

17 /** 

18 * Start the streaming service which would ideally create a 

19 * dedicated connection to the platform or a callback listener. 
Ideally 

20 * multiple connections requesting the same market data should not 

21 * be created. */ 

22 void startMarketDataStreaming(); 

23 

24 /** 

25 * Stop the streaming services and dispose any 

26 * resources/connections in a suitable manner such that no 

27 * resource leaks are created. 

28 */ 

29 void stopMarketDataStreaming(); 

30 

31} 


The MarketEventCallback interface, that is actually responsible for the further 
dissemination of the market data event synchronously or asynchronously, must be used 
in tandem. 


/** 
A callback handler for a market data event. The separate streaming 
event handler upstream, is responsible for handling and parsing the 
incoming event from the market data source and invoke the 
onMarketEvent of this handler, which in turn can disseminate the 
event if required, further downstream. Ideally, the implementer of 
this interface, would drop the event on a queue for asynchronous 
processing or use an event bus for synchronous processing. 
@param <T> 

The type of instrumentId in class TradeableInstrument 


COO ON DU BWN BP 
* * * * *¥* * * * * 


= 
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11 * @see TradeableInstrument 
12 * @see EventBus 


13 */ 

14 public interface MarketEventCallback < T > { 

15 /** 

16 * A method, invoked by the upstream handler of streaming market 
17 * data events. This invocation of this method is synchronous, 
18 * therefore the method should return asap, to make sure that the 
19 * upstream events do not queue up. 

20 - 

21 * @param instrument 

22 * @param bid 

23 * @param ask 

24 * @param eventDate 

25 */ 


26 void onMarketEvent(TradeableInstrument < T > instrument, double bid, 
double ask, DateTime eventDate) ; 
27} 


Let’s jump straight into the OANDA implementation, as things will become clearer 
once we look inside the code. 


A Concrete Implementation for 
MarketDataStreamingService 


Let’s start by looking at the class definition and the constructor for 
OandaMarketDataStreamingService, which is responsible for reading the market 
data stream from OANDA and then invoking the onMarketEvent on an instance of 
MarketEventCallback passed to the constructor. 


1 public class OandaMarketDataStreamingService extends 
OandaStreamingService implements MarketDataStreamingService { 


private final String url; 
private final MarketEventCallback < String > marketEventCallback; 


public OandaMarketDataStreamingService(String url, String accessToken, 
long accountId, Collection < TradeableInstrument < String >> 
instruments, 

8 MarketEventCallback < String > marketEventCallback, 

9 HeartBeatCallback < DateTime > heartBeatCallback, String 

heartbeatSourceld) { 


NOW BPWN 


10 
11 super(accessToken, heartBeatCallback, heartbeatSourceld) ; 
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12 this.url = url + OandaConstants.PRICES RESOURCE + "?accountId=" + 
accountId + "&instruments=" + instrumentsAsCsv(instr\ 13 uments); 

14 this.marketEventCallback = marketEventCallback; 

15} 

16 

17 private String instrumentsAsCsv(Collection < TradeableInstrument < 
String >> instruments) { 

18 StringBuilder csvLst = new StringBuilder(); 


19 boolean firstTime = true; 

20 for (TradeableInstrument < String > instrument: instruments) { 
21 if (firstTime) { 

22 firstTime = false; 

23 } else { 

24 csvLst.append(TradingConstants. ENCODED COMMA) ; 
25 

26 csvLst.append(instrument.getInstrument()); 

27 

28 return csvLst.toString(); 

29} 


The constructor among other params, receives an account ID and a list of 
instruments for which the ticks are desired. The method instrumentsAsCsv accepts 
a collection of instruments and returns a flattened string of URL-encoded comma- 
separated instruments. Assuming the account ID is 123456 and instrument list is ["EUR_ 
USD", "GBP_AUD" ], the URL computed in the constructor would look like this: 


//given 
public static final String PRICES RESOURCE = "/v1/prices"; 
//this.url computed, will look like below 


WPWN PR 


https://stream-fxtrade.oanda.com/v1/prices?accountId=123456&instruments 
=EUR_USD%2CGBP_AUD 


OANDA requires us to provide a valid account ID to set up a market data stream, 
as discussed. The stream URL is also different than the ones we discussed before, for 
example, the URL to request list of instruments. We will discuss these nuances in detail in 
a later chapter about configuration and deployment. 

This concrete implementation extends the OandaStreamingService class, which 
is the base class for providing infrastructure methods for all streaming services from 
OANDA, which includes market data and, as we will discuss in a future chapter, the event 
streaming. All streams from OANDA comprise a heartbeat payload that indicates the 
stream is alive, hence the HeartBeatCallback instance. We will discuss heartbeats in a 
later chapter. For now, it is sufficient to know that heartbeating provides a way to ensure 
the client (our trading bot), that the persistent connection to the brokerage platform is 
alive. If the heartbeat payload is not received in a given timeframe in the current stream, 
then something is not quite in order and we must disconnect and try reconnecting. Let’s 
quickly look at its definition and some important infrastructure methods it provides to its 
subclasses. 
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public abstract class OandaStreamingService implements 
HeartBeatStreamingService { 

protected volatile boolean serviceUp = true; 

private final HeartBeatCallback < DateTime > heartBeatCallback; 
private final String hearbeatSourceld; 

protected Thread streamThread; 

private final BasicHeader authHeader; 


protected abstract String getStreamingUr1(); 
protected abstract void startStreaming(); 
protected abstract void stopStreaming(); 


protected OandaStreamingService(String accessToken, HeartBeatCallback 
< DateTime > heartBeatCallback, 

String heartbeatSourceld) { 

this.hearbeatSourcelId = heartbeatSourceld; 

this .heartBeatCallback = heartBeatCallback; 

this.authHeader = OandaUtils.createAuthHeader(accessToken) ; 


} 


protected void handleHeartBeat(JSONObject streamEvent) { 
Long t = Long.parseLong(((JSONObject) streamEvent.get(OandaJsonKeys. 
heartbeat) ) .get(OandaJsonKeys.time) .toString()); 
heartBeatCallback.onHeartBeat (new HeartBeatPayLoad < DateTime > (new 
DateTime(TradingUtils.toMillisFromNanos(t)), hear\ 

beatSourceld)); 

} 


protected BufferedReader setUpStreamIfPossible(CloseableHttpClient 
httpClient) throws Exception { 

HttpUriRequest httpGet = new HttpGet(getStreamingUrl()); 
httpGet . setHeader(authHeader) ; 

httpGet .setHeader(OandaConstants.UNIX_DATETIME HEADER); 

LOG. info(TradingUtils.executingRequestMsg(httpGet) ) ; 
HttpResponse resp = httpClient.execute(httpGet) ; 

HttpEntity entity = resp.getEntity(); 

if (resp.getStatusLine().getStatusCode() == HttpStatus.SC OK && 
entity != null) { 

InputStream stream = entity.getContent(); 

serviceUp = true; 

BufferedReader br = new BufferedReader (new 

InputStreamReader (stream) ) ; 

return br; 

} else { 


65 


CHAPTER 4 — EVENT STREAMING: MARKET DATA EVENTS 


40 String responseString = EntityUtils.toString(entity, "UTF-8"); 
41 LOG.warn(responseString) ; 

42 return null; 

43 } 

44} 

45 

46 protected void handleDisconnect(String line) { 

47 serviceUp = false; 

48 LOG.warn( 

49 String. format("Disconnect message received for stream %s. PayLoad->%s", 
50 getHeartBeatSourcelId(), line)); 

51} 

52 

53 protected boolean isStreaming() { 

54 return serviceUp; 

ae 


In summary, the base class provides the following infrastructure (or supporting) 
services to its stream subclasses. 


e Set up a persistent stream connection to OANDA using 
getStreamingUr1() provided by a subclass that implements this 
abstract method. 


e Handle disconnect messages from OANDA, if for some reason 
OANDA disconnects the current stream. 


e Handle heartbeat payload and invoke the downstream 
HeartBeatCallback handler. 


Returning to our concrete implementation, let’s look at the most important method 
of the class, startMarketDataStreaming. It starts the streaming in a separate thread and, 
once the stream is established, parses the event payload received. 


import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys.ask; 
2 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys.bid; 
3 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 


disconnect; 

4 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
heartbeat; 

5 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
tick; 


import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys.time; 


public void startMarketDataStreaming() { 
stopMarketDataStreaming() ; 
11 this.streamThread = new Thread(new Runnable() { 


6 
7 
8 @Override 
9 
0 
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@Override 

public void run() { 

CloseableHttpClient httpClient = getHttpClient(); 

try { 
BufferedReader br = setUpStreamIfPossible(httpClient) ; 
if (br != null) { 


String line; 
while ((line = br.readLine()) != null && serviceUp) { 
Object obj = JSONValue.parse(line) ; 
JSONObject instrumentTick = (JSONObject) obj; 
// unwrap if necessary 
if (instrumentTick.containsKey(tick)) { 
instrumentTick = (JSONObject) instrumentTick.get(tick) ; 


if (instrumentTick.containsKey(OandaJsonKeys.instrument)) { 
final String instrument = instrumentTick.get(OandaJsonKeys. 
instrument) .toString(); 
final String timeAsString = instrumentTick.get(time).toString(); 
final long eventTime = Long.parseLong(timeAsString) ; 
final double bidPrice = ((Number) instrumentTick.get(bid)). 
doubleValue(); 
final double askPrice = ((Number) instrumentTick.get(ask)). 
doubleValue(); 
marketEventCallback.onMarketEvent ( 
new TradeableInstrument < String > (instrument), bidPrice, 
askPrice, 
new DateTime(TradingUtils.toMillisFromNanos(eventTime) )) ; 
} else if (instrumentTick.containsKey(heartbeat)) { 
handleHeartBeat (instrumentTick) ; 
} else if (instrumentTick.containsKey(disconnect)) { 
handleDisconnect (line); 
f 
} 


br.close(); 


} catch (Exception e) { 

LOG.error(e); 

} finally { 

serviceUp = false; 
TradingUtils.closeSilently(httpClient) ; 


}, "OandMarketDataStreamingThread") ; 
this.streamThread.start(); 
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57 

58 @Override 

59 public void stopMarketDataStreaming() { 

60 this.serviceUp = false; 

61 if (streamThread != null && streamThread.isAlive()) { 
62 streamThread.interrupt(); 

63 }SW 

64} 


The startMarketDataStreaming begins by first invoking stopMarketDataStreaming. 
This is to make sure that we stop existing thread consuming events, if any, and start anew 
one. The use of this will become clear when you start to recognize the fact that we may 
have issues with connectivity and occasionally may need to restart the stream. 

Assuming that after this, we do not have an existing thread consuming market data 
events, we can now spawn another thread to start consuming the events. We notice 
that the run() method only exits if the condition line = br.readLine()) != null 
&& serviceUp evaluates to false. The value of the serviceUp method is set to false 
when we call the method stopMarketDataStreaming(). If the BufferedReader is set up 
before for streaming, it stops streaming events and returns a null, which also results 
in the termination of the while loop, resulting in the termination of the stream thread. 
Assuming the stream is streaming market data events for the desired instruments, we 
should see JSON responses such as the following ones in very quick succession. 


1 {"tick":{"instrument": "EUR USD", "time": "1401919213548144", "bid" :1.08479 
y "ask": 1.08498}} 

2 {"tick":{"instrument":"GBP_AUD", "time": "1401919213548822", "bid":2.07979 
» "ask": 1.08998}} 

3 {"heartbeat": {"time":"1401919213548226"}} 

4 {"tick":{"instrument”: "EUR USD", "time": "1401919217201682", "bid": 1.08484 
) "ask": 1.08502}} 


Basically, if the number of instruments set up is quite large (say > 10), the likelihood 
is that several ticks may be received per second, especially when London is online. 

Looking at the parsing code, we notice that the code handles three types of payload 
with the following keys: 


e ~—- Tick 
e Heartbeat 
e Disconnect 


A disconnect payload looks like this: 


1  {"“disconnect": {"code":60,"message": "Access Token connection limit 
exceeded: This connection will now be disconnected", "m\ 


2. oreInfo": "http: \/\/developer.oanda.com\/docs\/v1\/troubleshooting" }} 
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For the tick payload, we parse the JSON payload into bidPrice, askPrice, 
instrument, and eventTime, and then delegate to the marketEventCallback. 
onMarketEvent, which may process the tick synchronously or asynchronously. In either 
case, it is supremely important that this invocation is super fast, else the events will start 
to queue up and we may introduce unwanted lag in the system, which may throw some 
strategies, consuming these events, off course, as it would not reflect the most recent 
prices. 

The heartbeat and the disconnect payloads are handled by the super class, as 
discussed. 


1 protected void handleHeartBeat(JSONObject streamEvent) { 

2 Long t = Long.parseLong(((JSONObject) streamEvent.get(heartbeat)). 
get(time) toString()); 

3 heartBeatCallback.onHeartBeat (new HeartBeatPayLoad < DateTime > (new 
DateTime(TradingUtils.toMillisFromNanos(t)), hearb\ 


4  eatSourceld)); 

5 

6 

7 protected void handleDisconnect(String line) { 

8 serviceUp = false; 

9 LOG.warn( 

10 String. format("Disconnect message received for stream %s. PayLoad->%s", 
11 getHeartBeatSourceld(), line)); 

12. +} 


That brings us to the end of the discussion of the upstream event handling and 
parsing. As we will discover in later chapters, heartbeating is central to keeping the stream 
alive. We must take these heartbeats seriously and act swiftly if these heartbeats cease, in 
the form of restarting these streams, so that our strategies do not make wrong decisions. 
In the next section, we discuss how the events might be consumed downstream via the 
marketEventCallback.onMarketEvent. 


Downstream Market Data Event Dissemination: 
MarketEventCallback 


In order to understand what exactly happens to our market data event downstream, we 
need to look into a sample implementation of the MarketEventCallback interface. 


1 public class MarketEventHandlerImpl < T > implements 
MarketEventCallback < T > { 


private final EventBus eventBus; 


public MarketEventHandlerImp1(EventBus eventBus) { 
this.eventBus = eventBus; 


} 


NOW PWN 
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9 @Override 
10 public void onMarketEvent(TradeableInstrument < T > instrument, double 
bid, 

11 double ask, DateTime eventDate) { 

12 MarketDataPayLoad < T > payload = new MarketDataPayLoad < T > 
(instrument, bid, ask, eventDate); 

13 eventBus. post (payload) ; 

14 } 


16 =} 


The implementation MarketEventHandlerImp1 could not have been simpler. 
Basically, it is delegating the event dissemination to the Google EventBus, which 
depending on how it is configured (synchronously or asynchronously), will disseminate 
this event to any method that has the annotation @Subscribe and has the input 
parameter MarketDataPayLoad<T> to a void method. A method signature would look like 
this: 


1  @Subscribe 

2  @AllowConcurrentEvents 

3. public void handleMarketDataEvent (MarketDataPayLoad<T> 
marketDataPayLoad) { 


wi 


; = 


That is it!! You can create any number of such subscribers and get a callback from the 
event bus with the MarketDataPayLoad payload. You will see in later chapters how you 
can plug in subscribers, such as components based on trading strategies, that are heavy 
consumers of market data. 


Try It Yourself 


In this section, we are going to create a demo program that will output market data and 
heartbeat events streamed to MarketDataStreamingService by the platform. 


package com.precioustech. fxtrading.oanda.restapi.streaming.marketdata; 


import java.util.Collection; 


import org.apache.log4j.Logger; 


1 
2 
3 
4 
5 import org.apache.commons.lang3.StringUtils ; 
6 
7 import org. joda.time.DateTime; 

8 

9 


import com.google.common.collect.Lists ; 
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26 
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28 


29 
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import com.google.common.eventbus.AllowConcurrentEvents ; 

import com.google.common.eventbus.EventBus ; 

import com.google.common.eventbus. Subscribe; 

import com.precioustech. fxtrading.heartbeats.HeartBeatCallback; 
import com.precioustech. fxtrading. heartbeats .HeartBeatCallbackImp1; 
import com.precioustech. fxtrading.heartbeats.HeartBeatPayLoad ; 
import com.precioustech. fxtrading. instrument. TradeableInstrument ; 
import com.precioustech. fxtrading.marketdata.MarketDataPayLoad ; 
import com.precioustech. fxtrading.marketdata.MarketEventCallback; 
import com.precioustech. fxtrading.marketdata.MarketEventHandlerImp] ; 
import com.precioustech. fxtrading.streaming.marketdata. 
MarketDataStreamingService ; 


public class MarketDataStreamingServiceDemo { 


private static final Logger LOG = Logger.getLogger (MarketDataStreaming 
ServiceDemo.class); 


private static void usageAndValidation(String[] args) { 
if (args.length != 3) { 
LOG.error("Usage: MarketDataStreamingServiceDemo <url> <accountid> 
<accesstoken>"); 
System.exit(1); 
} else { 
if (!StringUtils.isNumeric(args[1])) { 
LOG.error("Argument 2 should be numeric"); 
System.exit(1); 
} 
} 
} 


private static class DataSubscriber { 


@Subscribe 
@AllowConcurrentEvents 
public void handleMarketDataEvent (MarketDataPayLoad < String > 
marketDataPayLoad) { 
LOG. info(String.format("TickData event: %s @ %s. Bid Price = %3.5f, 
Ask Price = %3.5f", 
marketDataPayLoad.getInstrument().getInstrument(), 
marketDataPayLoad.getEventDate(), 
marketDataPayLoad.getBidPrice(), marketDataPayLoad.getAskPrice())); 
} 


@Subscribe 
@AllowConcurrentEvents 
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public void handleHeartBeats(HeartBeatPayLoad < DateTime > payLoad) { 
LOG. info(String.format("Heartbeat received @ %s from source %s", 
payLoad.getHeartBeatPayLoad(), 

payLoad. getHeartBeatSource())); 

i 


} 
public static void main(String[] args) throws Exception { 


usageAndValidation(args) ; 

final String url = args[0]; 

final Long accountId = Long.parseLong(args[1]); 
final String accessToken = args[2]; 

final String heartbeatSourceId="DEMO_MKTDATASTREAM" ; 


new TradeableInstrument < 


TradeableInstrument < String > eurusd 
String > ("EUR_USD"); 
TradeableInstrument < String > gbpnzd 
String > ("GBP_NZD"); 


new TradeableInstrument < 


Collection < TradeableInstrument < String >> instruments = Lists. 
newArrayList(eurusd, gbpnzd); 


EventBus eventBus = new EventBus(); 
eventBus.register(mew DataSubscriber()); 


MarketEventCallback < String > mktEventCallback = new 
MarketEventHandlerImpl < String > (eventBus); 
HeartBeatCallback < DateTime > heartBeatCallback = new 
HeartBeatCallbackImpl < DateTime > (eventBus); 


MarketDataStreamingService mktDataStreaminService = new OandaMarketDa 
taStreamingService(url, 

accessToken, 

accountId, instruments, mktEventCallback, heartBeatCallback, 
heartbeatSourceld); 

LOG. info("+++++++4+4++++ Starting Market Data Streaming 
FH4444444444444444444") 5 
mktDataStreaminService.startMarketDataStreaming() ; 
Thread.sleep(20000 L); 
mktDataStreaminService.stopMarketDataStreaming(); 
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Name: MarketDataStreamingServiceDemo 


BE) %y Ciasspatn| Source) I Envzonment |] Common| 


https://stream-fxtrade.canda.com Fa" 
(Ret neon ee a e at p enh A A RRA ET EE 


© Use the -XstartOnFirstThread argument when launching with SWT 


Working directory: 
© Defoutt: 
©) Other: 


coco 


Figure 4-1. Launch configuration 
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2016-01-27 10:53:19,814 INFO [main} ~ «ssseeresees Starting Market Dete Streaming ++++e+ eerrrrrtry 

2816-01-27 10:53:20,864 INFO [ondilorketOotoStreasingThread] - Cxecuting request : GET https-//streas-fxtrode.conde. con/vi/prices?eccount!¢-Tébibthinstrunent s-fUR_USOK2CCE 
2016-01-27 10:53:22,474 INFO [OondMorketOoteStreasinglhread] - kOete event: CUR_USO @ 2016-1 $3: 22 090001 :08. &: 

2816-01-27 10:53:22,495 INFO (OandMarketBatoStreasingThread) ~- TickDete event: GRP_NZD @ 2016-1 28:53:19. 74300108. B rice = 2.19826, Ask 
2816-01-27 10:53:22,497 INFO (OandMorketDatcStreasingThread) - Heartbeot received @ 2016-@1-27718:53:22.242+01-08 from source OFMO_MCTOATASTREAM 
2816-01-27 10:53:23,304 INFO [OandMarketOotoStreaningThread) - TickDete event: GBP_N20 @ 2016-@1-27738:53; 23. 247601: id Price = 2.19828, Ask Price = 2.19915 
2816-01-27 10:53:24,522 INFO [OandMorketOataStreasingthread) - TickDete event: GBP_N20 amie L277: ice = 2.19826, Ask Price e 
2B16-01-27 10:53:24,694 INFO [OandMorketOataStreaningthread) - TickDete event: GBP_NZO rice = 2.19828, Ask Price 
TV16-O1-27 10:53:24,886 INFO [OandMorketDatoStreawingthreed) - Neortbeet received @ 2816 444001:08 from source OLMO_METOATASTREAM 
2016-01-27 10:53:26,976 INFO [OandMorketOoteStreawingthreed) - TickOete event: = 2.19825, Atk Price 
2016-01-27 10:53:27,096 IMFO ([OandMorketDateStrecwingIhreed) - Tickbete event: ~ 2.19827, Atk Price 
2816-01-27 10, 27,097 INFO [OandMarketBoteStreawingThreed) - Tickbete event: rice = 2.19842, Ask Price 
2016-01-27 10:53:27,098 INFO (OondMorketOateStreaningThreed) - TickDete event: $3:27.076+01:08. 8 rice = 2.19841, Ask Price 
2016-01-27 10:53:27,227 INFO (OondMorketDateStrecningthresd) - 27242601208 free source OEMO_MKTOATASTREAM 
2816-01-27 10:53:27,304 INFO [OandMorketOatoStreaningthread) - Tickbete event: : 208. . Ask Price 
2016-01-27 10:53:27,305 INFO [OandMorketBotoStreasingthread) ~ TickDete event: 3 le Ask 
2016-01-27 10:53:27,899 INFO [OondMorketOotoStreasingThread) - Tickbete event: Ey 108. Ask 
2016-01-27 10, 8 (OandMarketOatoStreamingThread) ~ TickDete event: H 8. . Ask 
2816-01-27 10; [OandMarketOateStreavingThread] - TickDete events » 128. 5 Ask 
2816-01-27 10; [OandMorketBeteStreawingThreed) - TickDete event: N20 . 5 . Ask 
2816-01-27 18: ([OandMarketOateStreamingihreed) - TickDete event: 5 5 Ask 
2816-01-27 10 (OandMarketOoteStreamingthread) ~ TickDate event: -81- J t Ask 
2016-01-27 10: (OandMarketOoteStreasingthread) - TickDete event: af Ask 
2016-01-27 10:53:28,976 INFO [OondMarketOotcStrecningThread) - Tickfete event: a i lt ask 
2816-01-27 10) [OandMorketOoreStrecwingthreed] - Tickbete event: 2 208, ask 
2016-01-27 10 [OondMorketDoteStrecsingThread) - a: 

2816-01-27 10 [OandMarketDotaStreasingThread) - 

2816-01-27 10: (OandMorketDatoStreamingThread) ~ TickDete event: 

2816-01-27 10 (OandMarketOoteStreasingThread] ~ TickDete event: 

2016-01-27 10; (OandMarketOataStreaningThread] - TickDete event: 

2016-01-27 10; [OandMarketOatoStreamingThread] - TickDete event: 

2816-01-27 10: [OandMarketOateStreamingthread] - TickOete event: 

2816-01-27 10; (DandMorketOetoStreavingIhreed) - TickDete event: 

2816-01-27 18: [OandMorketOateStreasingthreed) - TickDete event: 

2816-01-27 10 (OandlarketDateStreamingThread] - TickDete event: 

2016-01-27 (OandMarketGateStreamingThread) - TickDete event: G8P_NZD 

2016-01-27 (OandMarketOataStrearingthread] ~ Heartbeat received @ 2016-01- 

2016-01-27 [OondMarketOatcStreasingthresd] - Tickbeto event: G8P_NZO @ 2011 . 19930 
2016-01-27 (ondMorketOatoStreavingthreed)] - TickDete event: GBP_NZO @ 2016-@1-27T2) B 708. Price = 2 


Figure 4-2. Sample output 
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Historic Instrument 
Market Data 


In this chapter we discuss some of the techniques to build services to query historic 
market data. This could be of real interest for folks who want to build strategies based on 
analysis of historic data for given instruments. Traditionally, historical instrument data 
on charts are represented as candlesticks. Candlestick patterns are a form of technical 
analysis that can be used over any time frame. They are similar to bar charts and provide 
opening and closing values, the high and low price for the time frame in question. 


How to Read a Candlestick 


The length of the candlestick shows the relative change in the open and close prices of 
the reporting time frame (session). The longer the body, the more the change in the open 
and close price of the session. This may point to higher volatility in the price. If the close 
price is higher than the open, the body of the candlestick is white. On the contrary, if the 
close price is lower than the open, the body is black. The thin lines above and below the 
body are called shadows. The peak of the upper shadow is the high of the session and 

the bottom of the lower shadow is the low of the session. The length and the color of the 
candlesticks can point to a bull or a bear market. See Figure 5-1. 


high, — Shadow 


cl open 
Real 
Body 
open 2 close 
low™ 
Figure 5-1. Candlestick 
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Enum Defining the Candlestick Granularity 


We start our journey of making sense of the market data by first defining an enum that 
defines various candlesticks’ granularity or time frames that we will support. See Listing 5-1. 


Listing 5-1. CandleStickGranularity Enum Definition 


public enum CandleStickGranularity { 


1 
2 

3 =$5(5), // 5s 

4 $10(10), // 10s 

5 $15(15), // 15s 

6 $30(30), // 30s 

7 M1(60 * 1), // 41min 

8 M2(60 * 2), // 2mins 

9 M3(60 * 3), // 3mins 

0 M5(60 * 5), // Smins 

11 M10(60 * 10), // 10mins 
12 M15(60 * 15), // 15mins 
13 M30(60 * 30), // 30mins 
14 H1(60 * 60), // thr 

15 H2(60 * 60 * 2), // 2hr 


16 H3(60 * 60 * 3), // 3hr 
17 H4(60 * 60 * 4), // 4hr 
18 H6(60 * 60 * 6), // 6hr 
19 H8(60 * 60 * 8), // 8hr 


20 H12(60 * 60 * 12), // 12hr 

21 D(60 * 60 * 24), // 1day 

22 W(60 * 60 * 24 * 7), // 1wk 
23 M(60 * 60 * 24 * 30); // 1mth 


24 

25 private final long granularityInSeconds; 

26 

27 private CandleStickGranularity(long granularityInSeconds) { 
28 this.granularityInSeconds = granularityInSeconds; 
29 } 

30 

31 public long getGranularityInSeconds() { 

32 return granularityInSeconds; 

a Od 

34} 


This enum definition is quite straightforward. We define all the granularities or time 
frames that our API will support. The lowest granularity is five seconds and the largest is 
one month. We define a constructor to accept granularityInSeconds(), just in case we 
need to quantify the granularity in a situation where we parse the enum by name and need 
to get its granularity or session length. 
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Define POJO to Hold Candlestick Information 


We now turn our attention to defining the POJO that will hold all the candlestick 
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information, shown in Listing 5-2. 


Listing 5-2. Candlestick POJO 


1 
2 
3 
4 
5 
6 
7 
8 
9 
0 


27 
28 
29 
30 
31 
32 
33 
34 


35 


public 


/*All prices are average of bid and ask ,i.e (bid+ask)/2*/ 


class CandleStick < T > { 


private final double openPrice, 
highPrice, 

lowPrice, 

closePrice; 

private final DateTime eventDate; 
private final TradeableInstrument < T > instrument; 
private final CandleStickGranularity candleGranularity; 
private final String toStr; 
private final int hash; 


public CandleStick(double openPrice, double highPrice, double 


lowPrice, 

double closePrice, DateTime eventDate, TradeableInstrument < T > 
instrument, 

CandleStickGranularity candleGranularity) { 

super() ; 

this.openPrice = openPrice; 


this. 
this. 
this. 
this. 
this. 
this. 
this. 
this. 


highPrice = highPrice; 

lowPrice = lowPrice; 

closePrice = closePrice; 

eventDate = eventDate; 

instrument = instrument; 
candleGranularity = candleGranularity; 
hash = calcHash(); 

toStr = String. format ( 
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"Open=%2.5f, high=%2.5f, low=%2.5f,close=%2.5f,date=%s, 
instrument=%s, granularity=%s", 
openPrice, highPrice, lowPrice, closePrice, eventDate, instrument, 
candleGranularity.name()); 


} 


private int calcHash() { 
final int prime = 31; 
int result = 1; 


result = prime * result + ((candleGranularity == null) ? -1: 


candleGranularity.ordinal()); 


result = prime * result + ((eventDate == null) ? 0: 


hashCode()); 


eventDate. 
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36 result = prime * result + ((instrument == null) ? 0 : instrument. 
hashCode()); 

37 return result; 

38 } 

39 


40 @Override 

41 public int hashCode() { 

42 return hash; 

43} 

44 

45 @Override 

46 public boolean equals(Object obj) { 
47 if (this == obj) 


48 return true; 

49 if (obj == null) 

50 return false; 

51 if (getClass() != obj.getClass()) 
52 return false; 


53 CandleStick other = (CandleStick) obj; 

54 if (candleGranularity != other.candleGranularity) 
55 return false; 

56 if (eventDate == null) { 


57 if (other.eventDate != null) 

58 return false; 

59 } else if (!eventDate.equals(other.eventDate) ) 
60 return false; 

61 if (instrument == null) { 

62 if (other.instrument != null) 

63 return false; 

64 } else if (!instrument.equals(other. instrument) ) 
65 return false; 

66 return true; 

67 ¥ 

68 


69 @Override 

70 public String toString() { 
71 return this. toStr; 

72 } 


74 public CandleStickGranularity getCandleGranularity() { 
75 return candleGranularity; 
76 } 


78 public TradeableInstrument < T > getInstrument() { 


79 return instrument; 
80 } 


78 
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public double getOpenPrice() { 
return openPrice; 


} 


public double getHighPrice() { 
return highPrice; 


} 


public double getLowPrice() { 
return lowPrice; 


} 


public double getClosePrice() { 
return closePrice; 


} 


public DateTime getEventDate() { 
return eventDate; 

} 

} 
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Except for eventDate, all the attributes are self explanatory following our earlier 


discussion on “how to read a candlestick” We should have expected a start and end date 
but we have only a single eventDate attribute. Why is it so? Actually given the granularity 
of the candlestick and its start time, the end date can be worked out. So eventDate is 
actually the start of the candlestick period. 


Regarding the hashCode() and equals() methods, the following three attributes 


participate and are deemed to ascertain if a candlestick is unique in a collection or not. 


1 
2 
3 


private final DateTime eventDate; 
private final TradeableInstrument<T> instrument; 
private final CandleStickGranularity candleGranularity; 


Historical Data Provider Interface 


All price attributes in the POJO are assumed to be the average of bid and ask prices. 


It is now time to define the historical data provider interface that will specify what needs 
to be implemented in order to retrieve meaningful candlestick data for analysis (see 
Listing 5-3). 


Listing 5-3. HistoricMarketDataProvider Interface 


WPWN 


/** 


* A provider of candle stick data for a given instrument. The candle 
* sticks must be in chronological order in order to easily construct 


* time series information. 
* @param <T> 
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6 ‘ The type of instrumentId in class TradeableInstrument 

7 * @see TradeableInstrument 

8 */ 

9 public interface HistoricMarketDataProvider < T > { 

10 

11 /** 

12 * Construct candle sticks for a given from and to period. 

13 * 

14 * @param instrument 

15 = » for which the candle stick information is requested 

16 * @param granularity 

17 * , the time interval between 2 candle sticks 

18 * @param from 

19 * , the start of first candle stick 

20 * @param to 

21 * , the end of last candle stick 

22 * @return List<CandleStick<T>> chronologically ordered. 

23 */ 

24 List < CandleStick < T >> getCandleSticks(TradeableInstrument < T > 
instrument, 

25 CandleStickGranularity granularity, DateTime from, DateTime to); 

26 

27 /** 

28 * Construct last "count" candle sticks. This could be translated to 

29 * an invocation of the overloaded method above which requires 

30 * "from" and "to" date, if appropriate. The "to" date = now() and 

31 * "from" date = now() -granularity *count 

32 - 

33 * @param instrument 

34 * » for which the candle stick information is requested 

35 * @param granularity 

36 * , the time interval between 2 candle sticks 

37 * @param count 

38 . , 

39 * @return List<CandleStick<T>> chronologically ordered. 

40 */ 

41 List < CandleStick < T >> getCandleSticks(TradeableInstrument < T > 
instrument, 

42 CandleStickGranularity granularity, int count); 

43 } 


As usual, this interface definition looks quite straightforward. The two overloaded 
methods, one of which accepts a from and to time period, and the other requires the last 
count of candlesticks, are all that is needed to retrieve the necessary candlesticks. The 
choice of return type list instead of collection guarantees that there is a certain order 
to the candlesticks, in this case chronological. 
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A Concrete Implementation for 
HistoricMarketDataProvider 


We begin our discussion of the OANDA implementation by first taking a quick look at 
a sample JSON returned when we request candlestick information. Listing 5-4 is for 
granularity Daily. 


Listing 5-4. Sample JSON for Candlesticks 


1. 4 

2 "instrument": "GBP_USD", 
3 "granularity": "D", 

4 "candles": [ 

5 { 

6 "time": "1442098800000000", 
7 "openMid": 1.54301, 
8 "“highMid": 1.544695, 
9 "lowlid": 1.54284, 
10 "closeMid": 1.544295, 
11 "volume": 868, 

12 "complete": true 
13 }, 
14 { 
15 "time": "1442185200000000" , 
16 “openMid": 1.544245, 
17 "“highMid": 1.54594, 
18 "lowMid": 1.54376, 
19 "closeMid": 1.54406, 
20 "volume": 3765, 
21 "complete": false 
22 } 
23 ] 
24 4} 


The JSON keys that we need to statically import in our provider class are: 


1 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
candles; 

2 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
closeMid; 

3 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
highMid; 

4 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
lowMid; 

5 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
openMid; 

6 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys.time; 
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As usual, replacing T param type in the interface definition with String gives us the 


following class definition: 


1 


public class OandaHistoricMarketDataProvider implements HistoricMarketDa 
taProvider<String> { 


For the constructor definition, it is sufficient to provide the OANDA service URL and 


an access token. 


Au PWN PR 


private final String url; 

private final BasicHeader authHeader; 

public OandaHistoricMarketDataProvider(String url, String accessToken) { 
this.url = url;// OANDA REST service base url 
this.authHeader = OandaUtils.createAuthHeader(accessToken) ; 


} 


The candlestick resource endpoint is 
public static final String CANDLES RESOURCE = "/v1/candles"; 


So our functions to compute the URLs to retrieve candlesticks first with the date 


range and others with the count, respectively, are 


13 
14 


private static final String tzLondon = "Europe%2FLondon"; 


String getFromToUrl(TradeableInstrument < String > instrument, 
CandleStickGranularity granularity, 
DateTime from, DateTime to) { 
return String. format( 
"S48? instrument=%s&candleFormat=midpoint&granularity=%s&dailyAlignme 
nt=0&alignmentTimezone=%s&start=%d&end=%d", 
this.url, OandaConstants.CANDLES RESOURCE, instrument. 
getInstrument(), 
granularity.name(), tzLondon, TradingUtils.toUnixTime(from) , 
TradingUtils.toUnixTime(to)); 


} 


String getCountUrl(TradeableInstrument < String > instrument, 
CandleStickGranularity granularity, int count) { 


return String. format ( 
"S45 ?instrument=%s&candleFormat=midpoint&granularity=%s&dailyAlignme 
nt=0&alignment Timezone=%s&count=%d", 

this.url, OandaConstants.CANDLES RESOURCE, instrument. 
getInstrument(), granularity.name(), 


tzLondon, count); 


} 
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19 //Test invocation code 
20 TradeableInstrument<String> euraud = new TradeableInstrument<String>(" 
EUR AUD"); 


22. DateTime fromDate=new DateTime(1442098800000L ) ; 

23 DateTime toDate = new DateTime(1442185200000L) ; 

24 String fromToUrl = getFromToUrl(euraud, CandleStickGranularity.S5, 
fromDate ); 

25 System.out.println("FromToUr1:"+fromToUr1) ; 

26 =©System.out.println("*****") ; 

27. = int count=5; 

28 String countUrl=getCountUrl(euraud,CandleStickGranularity.S5 ,count); 

29 System.out.println("CountUr1:"+countUr1) ; 


Output from this test code invocation would look like this: 


1 FromToUrl:https://api-fxtrade.oanda.com/v1/candles?Instrument=EUR_AUD&ca 
ndleFormat=midpoint&granularity=S5&dailyAlignmen\ 

2 = t=0&alignmentTimezone=Europe%2FLondon&start=1442098800000000&e 
nd=1442185200000000 

3 2K KKK 

4  CountUrl:https://api-fxtrade.oanda.com/v1/candles?Instrument=EUR_AUD& 
candleFormat=midpoint&granularity=S5&dailyAlignment\ 

5 =0&%alignmentTimezone=Europe%2FLondon&count=5 


Some key observations from these code snippets are: 


e Weneed to provide an alignment time zone. This is the time zone 
in which the start timestamp for a candlestick will be reported. 


e The from and to timestamps must be provided as a UNIX 
timestamp, which has nanosecond precision. 


e The parameter candleFormat=midpoint is requesting OANDA 
to provide bid/ask prices as averaged prices instead of providing 
them separately. 


e = The dailyAlignment=0 is the hour of day used to align the 
candlesticks if granularity >= D. The value ranges from 0 to 23. 
In our case, we are requesting the candlesticks to be aligned at 
midnight London time. 


e = More information about candlestick URL params can be found at 
http: //developer.oanda.com/rest- live/rates/#aboutCandle 
stickRepresentation!. 


We now turn our attention to the discussion of the two overloaded methods that 
actually delegate the main logic to a private method that retrieves, parses, and returns the 
list of candlesticks. 


‘http: //developer.oanda.com/rest-live/rates/#aboutCandlestickRepresentation 
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@Override 
public List < CandleStick < String >> getCandleSticks(TradeableInstrume 
nt < String > instrument, 

CandleStickGranularity granularity, DateTime from, DateTime to) { 
return getCandleSticks (instrument, 

getFromloUrl(instrument, granularity, from, to), granularity); 
} 


@0verride 
public List < CandleStick < String >> getCandleSticks(TradeableInstrume 
nt < String > instrument, 
CandleStickGranularity granularity, int count) { 
return getCandleSticks(instrument, 
getCountUrl(instrument, granularity, count), granularity); 
} 


private List < CandleStick < String >> getCandleSticks(TradeableInstrum 
ent < String > instrument, 
String url, CandleStickGranularity granularity) { 
List < CandleStick < String >> allCandleSticks = Lists.newArrayList(); 
CloseableHttpClient httpClient = getHttpClient(); 
try { 
HttpUriRequest httpGet = new HttpGet(url); 
httpGet . setHeader(authHeader) ; 
httpGet .setHeader(OandaConstants.UNIX_DATETIME HEADER); 
LOG. info(TradingUtils.executingRequestMsg(httpGet) ) ; 
HttpResponse resp = httpClient.execute(httpGet) ; 
String strResp = TradingUtils.responseToString(resp) ; 
if (strResp != StringUtils.EMPTY) { 
Object obj = JSONValue.parse(strResp) ; 
JSONObject jsonResp = (JSONObject) obj; 
JSONArray candlsticks = (JSONArray) jsonResp.get(candles); 


for (Object 0: candlsticks) { 
JSONObject candlestick = (JSONObject) 0; 


final double openPrice = ((Number) candlestick.get(openMid)). 
doubleValue(); 

final double highPrice = ((Number) candlestick.get(highMid)). 
doubleValue(); 

final double lowPrice = ((Number) candlestick.get(lowMid)). 
doubleValue(); 

final double closePrice = ((Number) candlestick.get(closeMid)). 
doubleValue(); 

final long timestamp = Long.parseLong(candlestick.get(time). 
toString()); 
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40 CandleStick < String > candle = mew CandleStick < String > 
(openPrice, highPrice, 

41 lowPrice, closePrice, new DateTime(TradingUtils. 
toMillisFromNanos(timestamp) ), 

42 instrument, granularity) ; 

43 allCandleSticks.add(candle) ; 

44 } 

45 } else { 

46 TradingUtils.printErrorMsg (resp) ; 

47 } 

48 } catch (Exception e) { 

49 LOG.error(e); 

50 } finally { 

51 TradingUtils.closeSilently(httpClient) ; 

52 } 

53 return allCandleSticks; 

54} 


The private method does the bulk of the work. The two public overloaded methods 
get the URL computed and then delegate the rest to this private method. The following 
line of code is extremely important since we are passing a UNIX timestamp as a query 
param (in case of date range) rather than as a formatted date string, which is what 
OANDA expects if the header is omitted. 


1  httpGet.setHeader(OandaConstants.UNIX DATETIME HEADER) ; 


The rest of the code is fairly straightforward. Once a successful response is received, 
we just have to parse the JSON payload that contains information for all the candlesticks 
requested. 


Discussion: An Alternate Database 
Implementation 


In this section, we briefly touch on an alternate way for retrieving candlestick 
information. A lot of installations have a tick data warehouse/database and might 
prefer to tap into these data sources. A tick database table might look like the following 
(assuming an INSTRUMENT table already exists which defines all tradeable instruments): 


1 CREATE TABLE TICK DATA 

2 ( 

3 TICK_ID INTEGER PRIMARY KEY, 

4 INSTRUMENT ID INTEGER NOT NULL REFERENCES INSTRUMENT(INSTRUMENT ID), 
5 TICK_EVENT_TIMESTAMP TIMESTAMP NOT NULL, 
6 BID PRICE DECIMAL NOT NULL, 
7 ASK PRICE DECIMAL NOT NULL 
8 
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Assuming that there is a market data feed that constantly populates our TICK_DATA 
table for every tick, we can pretty much provide all the information that OANDA REST 
API is providing. However, we have some work to do before we can present the data to the 
client in exactly the way OANDA does. At a high level, the following needs to happen. 

Case 1: Retrieve candlesticks given from and to dates and a granularity (G) fora 
given instrument (1). 


e Divide from, to time period into N intervals, each of length G. So 
interval 1(11) = [from, from+G], interval 2(12) = [from+G, 
from+2G] .. interval N(IN ) = [from+(N-1)*G, to]. 


e Using a SELECT query, retrieve all data for the instrument where 
TICK_EVENT_TIMES- TAMP is between the from and to dates, 
ordered by TICK_EVENT_TIMESTAMP. 


e For each row R retrieved, assign row to an interval IM such that 
R[TICK_EVENT TIMES- TAMP] value >= IM [0] and<= IM [1]. 
This will yield a collection of rows for each interval. 


e Weare now ina position to find the open, close, high, and low 
prices for each interval I. Lets say this interval I, has T rows 
R...R.: 

1 ie 


° — Open, ,=avg(R,[BID_PRICE], R,[ASK_PRICE]) 
° — Close,,= avg(R,.[BID_PRICE], R,, [ASK_PRICE]) 


° High, = max(avg(R [BID_PRICE], R,[ASK_PRICE]), avg(R,[BID_ 
PRICE], R,[ASK_PRICE])..avg(RT [BID PRICE], RT [ASK_PRICE])) 


¢ —LowM = min(avg(R [BID_PRICE], R, [ASK_PRICE]), avg(R,[BID_ 
PRICE], R,[ASK_PRICE])..avg(R,, [BID_ PRICE], R,, [ASK_PRICE])) 


e EventDateM =IM [0] 


Case 2: Retrieve candlesticks given count N and a granularity (G) for a given 
instrument (1). 


e Calculate date from=now() - N*G to=now() 
e = Call function that implements Case 1 


A skeleton of our database-based provider implementation might look like this: 


1 import org.apache.commons.lang3. tuple. ImmutablePair ; 

2 import com.google.common.collect.Maps; 

3 : 

AS aees 

5 public class DatabaseHistoricMarketDataProvider implements HistoricMark 
etDataProvider<Long> { 

6 {[* 

7 TickDataDao manages the database interaction and retrieves 

8 necessary tick data in the form of TickData POJOs. */ 

9 private final TickDataDao tickDataDao; 
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public DatabaseHistoricMarketDataProvider(TickDataDao tickDataDao) 
{ 


} 


private List<ImmutablePair<DateTime, DateTime>> 
getIntervals(DateTime from, DateTime to, 
CandleStickGranularity granularity) { 

/* 

implement the logic to divide from,to into pairs or tuples of date 
ranges that span granularity */ 

} 

private Map<ImmutablePair<DateTime,DateTime>, List<TickData>> 
distributeInTimeBuckets(List<ImmutablePair<DateTime, DateTime>> 
timeBuckets, 

List<TickData> tickDataList) { 
Map<ImmutablePair<DateTime,DateTime>, List<TickData>> 
distributionMap = Maps.newLinkedHashMap() ; 

/* 

Implement the logic to assign tick data from the database into 
various time range buckets. */ 

return distributionMap; 


this.tickDataDao = tickDataDao; 


private List<CandleStick<Long>> processTickDataBuckets (Map<Immutabl 
ePair<DateTime,DateTime>, 
List<TickData>> distributionMap, TradeableInstrument<Long> 
instrument, 
CandleStickGranularity granularity ) { 
yf 
Here each entry of map should generate a CandleStick P0JO. Also 
do the computations such as finding min, max and average of 
prices as discussed previously. */ 


} 


@Override 

public List<CandleStick<Long>> getCandleSticks(TradeableInstrument<Lo 
ng> instrument, CandleStickGranularity granularity, \ 

DateTime from, DateTime to) { 


List<ImmutablePair<DateTime,DateTime>> intervals = getIntervals 
(from, to, granularity) ; 
List<TickData> ticks = this.tickDao.getTicks(intrument.getId(), 
from, to); 
Map<ImmutablePair<DateTime,DateTime>, List<TickData>> 
distributionMap = 
distributeInTimeBuckets(intervals, ticks); 
return processTickDataBuckets(distributionMap, instrument, 
granularity) ; 
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47 
48 private ImmutablePair<DateTime, DateTime> getFromToDates( 
CandleStickGranularity granularity, int count) { 


49 DateTime to = DateTime.now(); 

50 /* 

51 Use granularity to go back in time "count" times, to arrive at "to" 
Date 

52 e/ 

oo J 


54 @Override 
55 public List<CandleStick<Long>> getCandleSticks(TradeableInstrument<Long> 


instrument, 
56 CandleStickGranularity granularity, int count) { 
57 ImmutablePair<DateTime,DateTime> fromToPair = getFromToDates 
(granularity, count) ; 
58 return getCandleSticks (instrument, granularity, fromToPair. 
getLeft(), fromToPair.getRight()); 
59 
60+} 


Candlesticks for Moving Average Calculations 


Moving averages are widely used in technical analysis and forecasting methods. All 
moving averages use candlestick data for computation. The three most widely used 
moving averages are: 


e SimpleMovingAverage (SMA): An SMA, also known as an 
arithmetic average, is the most common and simplest of 
the moving averages. It is simply the average of prices of the 
candlesticks. Each price is equally weighted. 


e WeightedMovingAverage (WMA): A WMA assigns a weighting 
factor to each value in the candlestick list according to its age. 
The most recent price gets the most weight and the first one gets 
the least weight. So for example, if there are N candlesticks, the 
Mth candlestick will have weight M/(N x (N+1)/2). The sum of 
weights always equates to 1.0. 


e ExponentialMovingAverage (EMA): An EMA also assigns a weight 
to each value, according to its age. And like WMA, the most 
recent price gets the most weight and the first one in the list gets 
the least weight. The weight calculation for each candlestick is 
slightly more involved and is discussed thoroughly at https: // 
en.wikipedia.org/wiki/Moving average#Exponential_moving_ 
average’. 


*https://en.wikipedia.org/wiki/Moving average#Exponential_moving average 
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MovingAverageCalculationService 


In this section we discuss MovingAverageCalculationService, which computes the 
averages that can help in technical analysis and forecasting methods. This service will 
only implement SMA and WMA. Let’s start with the constructor definition that only has 
one dependency, the HistoricMarketDataProvider. 


1 public class MovingAverageCalculationService < T > { 


2 

3 private final HistoricMarketDataProvider < T > 
historicMarketDataProvider; 

4 

5 public MovingAverageCalculationService(HistoricMarketDataProvider < T > 
historicMarketDataProvider) { 

6 this .historicMarketDataProvider = historicMarketDataProvider; 

7 } 


The main computations happen in the private methods calculateSMA and 
calculateWMA: 


1 /* 

2 * Simple average calculation of close price of candle stick 

3 */ 

4 private double calculateSMA(List < CandleStick < T >> candles) { 
5 double sumsma = 0; 

6 for (CandleStick < T > candle: candles) { 

7 sumsma += candle.getClosePrice(); 

8 } 

9 return sumsma / candles.size(); 

10 } 

11 

12 /* 

13 * If there are N candle sticks then, Mth candle stick will have 

weight 

14 * M/(N * (N+1)/2). Therefore the divisor D for each candle is (N * 
15 * (N41)/2) */ 
16 private double calculateWMA(List < CandleStick < T >> candles) { 
17 double divisor = (candles.size() * (candles.size() + 1)) / 2; 
18 int count = 0; 
19 double sumwma = 0; 
20 for (CandleStick < T > candle: candles) { 
21 count++} 
22 sumwma += (count * candle.getClosePrice()) / divisor; 
23 } 
24 return sumwma; 
25 } 
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For the calculations, we use the closePrice of the candlestick. The rest of the public 
methods are very straightforward and, after fetching the candlesticks, they delegate to 
the private methods for computation and return the results. The service exposes an 
optimized method calculateSMAand-WMAasPair that can compute the two together and 
return the results. This is provided so that we do not fetch the same data twice. This can 
be especially expensive if, for example, we want to get 10 years’ worth of data with Daily 
granularity both from OANDA and from a database query perspective. It might be fine if 
the data is cached, in which case individual computation methods can be used. 


RB 


public double calculateSMA(TradeableInstrument < T > instrument, int 
count, 

2 CandleStickGranularity granularity) { 

3 List < CandleStick < T >> candles = this.historicMarketDataProvider 
4 -getCandleSticks(instrument, granularity, count); 

5 return calculateSMA(candles) ; 

6 } 

7 

8 


public double calculateSMA(TradeableInstrument < T > instrument, 
DateTime from, DateTime to, 
9 CandleStickGranularity granularity) { 


10 List < CandleStick < T >> candles = this.historicMarketDataProvider. 
11 getCandleSticks(instrument, granularity, from, to); 

12 return calculateSMA(candles) ; 

13°} 

14 [* 

15 * Optimization to get the two together in one call 

16 */ 


17. public ImmutablePair < Double, Double > calculateSMAandWMAasPair 
(TradeableInstrument < T > instrument, 

18 int count, CandleStickGranularity granularity) { 

19 List < CandleStick < T >> candles = this.historicMarketDataProvider. 
getCandleSticks(instrument, granularity, count); 

20 return new ImmutablePair < Double, Double > (calculateSMA(candles), 
calculateWMA(candles)); 

21} 


23 public ImmutablePair < Double, Double > calculateSMAandWMAasPair(Tradea 
bleInstrument < T > instrument, 

24 DateTime from, DateTime to, CandleStickGranularity granularity) { 

25 List < CandleStick < T >> candles = this.historicMarketDataProvider. 

26 getCandleSticks(instrument, granularity, from, to); 

27 return new ImmutablePair < Double, Double > (calculateSMA(candles), 
calculateWMA(candles)); 


28 «oS 

29 

30 = public double calculateWMA(TradeableInstrument < T > instrument, int 
count, 
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CandleStickGranularity granularity) { 

List < CandleStick < T >> candles = this.historicMarketDataProvider. 
getCandleSticks(instrument, granularity, count); 

return calculateWMA(candles) ; 


} 


public double calculateWMA(TradeableInstrument < T > instrument, 
DateTime from, DateTime to, 

CandleStickGranularity granularity) { 

List < CandleStick < T >> candles = this.historicMarketDataProvider. 
getCandleSticks(instrument, granularity, from, to); 

return calculateWMA(candles) ; 


} 


Try It Yourself 


In this section we write demo programs to demonstrate the API methods for 
HistoricMarketDataProvider and MovingAverageCalculationService. 


1 
2 
3 
4 
5 
6 
7 
8 
9 


10 
11 


12 
13 
14 
15 


16 
17 
18 
19 


20 
21 
22 
23 


package com.precioustech. fxtrading.oanda.restapi.marketdata. historic; 
import java.util.List; 


import org.apache.log4j.Logger; 
import org. joda.time.DateTime; 


import com.precioustech. fxtrading. instrument. TradeableInstrument ; 
import com.precioustech. fxtrading.marketdata.historic.CandleStick; 
import com.precioustech.fxtrading.marketdata.historic. 
CandleStickGranularity ; 

import com.precioustech.fxtrading.marketdata.historic. 
HistoricMarketDataProvider ; 


public class HistoricMarketDataProviderDemo { 


private static final Logger LOG = Logger.getLogger(HistoricMarketDataP 
roviderDemo.class); 


private static void usage(String[] args) { 
if (args.length != 2) { 
LOG.error("Usage: HistoricMarketDataProviderDemo <url> 
<accesstoken>"); 
System.exit(1); 
} 
} 
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24 public static void main(String[] args) { 


25 usage(args) ; 

26 final String url = args[0]; 

27 final String accessToken = args[1]; 

28 HistoricMarketDataProvider < String > historicMarketDataProvider = 
new 

29 OandaHistoricMarketDataProvider(url, accessToken); 

30 TradeableInstrument < String > usdchf = new TradeableInstrument < 


String > ("USD CHF"); 
31 List < CandleStick < String >> candlesUsdChf = 
historicMarketDataProvider.getCandleSticks(usdchf, 


32 CandleStickGranularity.D, 15); 

33 LOG. info(String. format ("+++++++++4+++4+4+++4++ Last %d Candle Sticks with 
Daily Granularity for %s +++", 

34 candlesUsdChf.size(), usdchf.getInstrument())); 

35 

36 for (CandleStick < String > candle: candlesUsdChf) { 

37 LOG. info(candle) ; 

38 

39 TradeableInstrument < String > gbpaud = new TradeableInstrument < 


String > ("GBP_AUD"); 
40 DateTime from = new DateTime(1420070400000 L); // 01 Jan 2015 


41 DateTime to = new DateTime(1451606400000 L); // 01 Jan 2016 

42 List < CandleStick < String >> candlesGbpAud = 
historicMarketDataProvider.getCandleSticks(gbpaud, 

43 CandleStickGranularity.M, from, to); 

44 

45 LOG. info(String. format ("+++++++++++Candle Sticks From %s To %s with 
Monthly Granularity for %s +++", 

46 from, to, gbpaud.getInstrument())); 


47 for (CandleStick < String > candle: candlesGbpAud) { 
48 LOG. info(candle) ; 

49 } 

50 

51} 

52 

53} 
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— 
Name: HistoricMarketDataProviderDemo 


an ew 8 com so nee 


VM arguments: 


Variables... 


© Use the -XstartOnFirstThread argument when launching with SWT 


Working directory: 
© Defautt: 
©) Other: 


on 


Figure 5-2. Launch configuration 


@ savodoe |) Probiems (2, Declaration -° Search = Progress QD Corzoie Ft task List A) Tosks fae Coverage oy Gk Staging @ History x BE OM ro-mce 


<terminated> HivtorieMtarke!DataProviderDewo [Java Application) A lbrary/Java/Javavirusi Machines fick +7 0_71 jeasContentesHome/binfiava (27 Jan 2016 12:50:55) 
27 12:89:56,412 INFO [main] - Executing request : GET https://opi-fxtrode. comdc. com/vi/condles?ins trument-US0_CHFEcondleFormot-midpointéigronulority-lhdei LyAlignmer 
Lost 15 Condle Sticks with Daily Gremlority for USD_CHF ssssesssse 
+ low-@. 99258, close~t 88167, date-2816-81-11 181 -08:02 020.8: 
1» Lome®. 99669, <lose~t 00323, daten2016-81-12TOt -08:02. 028681 


instrument=TradeableInstrument (instrument. 
instrument=TredeableInstrunent [instruments 
‘redeablelnstrument [instrument + 
st . redeableInstrusent [instruments 
Low-@.99586,close=1.00151,date-2016-@1-15T01:03:02.000+81:08, instrument-TradeableInstrument [instrument~ 
Lowe1 20876, close=1.00195,date-2016-@1-17T01:08:02.020+81:08, instrument-TradeableInstrument [instrument~ 
Low-1. 00138, close-2. 00513, date-2016-@1 - 18101 08:08. 029+01:08, instrument-Tredeoblelnstrument [instrument- 
Low-2 80826, <lose-2 08337, dote-2816-@3 - 197101 -08: 02. C2B+: Anstrument-Tredeadlelnstrument [instrument- 


Open-3. 88519, 


[rain] - Open-2.20337, e Lew-@.99987, close-2.00598 ,date-2016-23-20T01 88:02. 02+ instrument-TroseableInstrument [instrument~ 
[rain] - Open-3.20685, E strument-Tradeablelnstrument [instrument= 
[main] - Open-1.20801, instrument-TredeableInstrument [instrument- 
[main] - Open-1.21580, instruent=TrodeableInstrument [instrument~ 
[rain] - Open-1.01632, nstrumenteTredeobleInstrument [instrument= 
[rain] - Open-2.21250, |, instrument=TrodeableInstrunent [instrument> 
[rain] - Open-t.01784, |, instrusent=TredeobleInstrument [instrumeat+ 
[main] - Executing request : GET hitps://opi-fatrode. com/vi/candles?instrument=GBP_AUDS.candleformct ami dpointSgranulari ty-Mbdet LyAligneer 
[main] - erreeeeeeeCandle Sticks From 2815-O1-@1701:00:08.800+01:08 To 2016-@1-@1781:20:08.082+01:62 with Monthly Granularity for G3P_AUD +++ 
[main] - Open-2.98211, high-2.95806, low-1.83428,close-1.93935,date-2014-12-31101:08:02.020+81:08, instrument-TradeableInstrunent [instrument~ 
[nain} - Open-2.94603, Low=1.91943, close-1.97676,éate-201S-@1-31101:08:02. 629+ instrument-Tredeoblelnstrusent [instrument~ 
[moin] - Open-2.97548, Low-2. 68332, close-2.9342 nstrument-Tredeoblelnstrument [instrument 
[rain] - Open-2.93413, , instrument-Treseablelnstrument [instrument- 
[rain] - Open-3.92986, instrument-Tredeablelnsteument [instrument- 
[rain] - Open-2. 20261, 7 instrument-TrodeableInstrument [instrumeat> 
[main] - Open-2.24997, high-2.1S162, instrument-TradeableInstrument [instrument= 
[main] - Open-2. 14825, high-2.24849, low-2. 28745, close+2. 15329, date-2015-@7-31 101 08: instrument=TradeableInstrument [instrument= 
Grain] - Open=2.15908, high-2.21103, low-2.13546,close-2. 16610, date~2015-@8-31701 08: instrument-TredeobleInstrusent [instruments 
[rain] - Open-2.16597, high-2.17347, lowe2.07911,close-2.16145, date-2015-@9-38T01 :08: instrusent-TrodeobleInstrument [instrument> 
[main] - Open-2.17191, high-2.17227, low-2.87336,<lose-2. 09325, date-2015 -18-31 101-08. instrument-TredeedleInstrument [instrument- 


2026-01-27 32: [main] - Open-2.89325, Migh-2.32184, low-2.82626,close-2.83486,date-2015 -31- 38701 -08. 
2016-@1-27 12:59:58,598 INFO [main] - Open-2.@3485, Nigh-2.09814, Low-2.21739,close-2.83428, date-2015-12-31101 :88:! 


Anstrument~TredeableInstrusent [instrument- 
Ansteument-TradeableInstrument [instrument. 


Figure 5-3. Sample output 
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package com.precioustech. fxtrading.oanda.restapi.streaming.marketdata ; 


import org.apache. commons. lang3.tuple.ImmutablePair ; 
import org.apache.log4j.Logger; 
import org. joda.time.DateTime; 


import com.precioustech. fxtrading. instrument. TradeableInstrument ; 
import com.precioustech. fxtrading.marketdata.historic. 
CandleStickGranularity ; 

import com.precioustech. fxtrading.marketdata.historic. 
HistoricMarketDataProvider ; 

import com.precioustech. fxtrading.marketdata.historic. 
MovingAverageCalculationService ; 

import com.precioustech.fxtrading.oanda.restapi.marketdata.historic. 
OandaHistoricMarketDataProvider ; 


public class MovingAverageCalculationServiceDemo { 


private static final Logger LOG = Logger. getLogger(MovingAverageCalcul 
ationServiceDemo.class); 


private static void usage(String[] args) { 
if (args.length != 2) { 
LOG.error("Usage: MovingAverageCalculationServiceDemo <ur1> 
<accesstoken>"); 
System.exit(1); 
} 
} 


public static void main(String[] args) { 
usage(args) ; 
final String url = args[o]; 
final String accessToken = args[1]; 
HistoricMarketDataProvider < String > historicMarketDataProvider = 
new OandaHistoricMarketDataProvider(url, accessToken) ; 
MovingAverageCalculationService < String > movingAverageCalcService = 
new MovingAverageCalculationService < String > 
(historicMarketDataProvider) ; 
TradeableInstrument < String > eurnzd = new TradeableInstrument < 
String > ("EUR_NZD"); 
final int countIntervals = 30; 
ImmutablePair < Double, Double > eurnzdSmaAndWma = 
movingAverageCalcService.calculateSMAandWMAasPair( 
eurnzd, countIntervals, CandleStickGranularity.H1) ; 


LOG. info( 
String. format ("SMA=%2.5f,WMA=%2.5f for instrument=%s, granularity=%s 
for the last %d intervals", 
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39 eurnzdSmaAndWma.left, eurnzdSmaAndWma.right, eurnzd.getInstrument(), 
40 CandleStickGranularity.H1, countIntervals)); 

41 DateTime from = new DateTime(1444003200000 L); // 5 Oct 2015 

42 DateTime to = new DateTime(1453075200000 L); // 18 Jan 2016 


44 TradeableInstrument < String > gbpchf = new TradeableInstrument < 
String > ("GBP_CHF"); 

45 ImmutablePair < Double, Double > gbpchfSmaAndWma = 

46 movingAverageCalcService.calculateSMAandWMAasPair(gbpchf, 

47 from, to, CandleStickGranularity.W) ; 


49 LOG. info( 
50 String. format ("SMA=%2.5f,WMA=%2.5f for instrument=%s ,granularity=%s 
from %s to %s", 


51 gbpchfSmaAndWma.left, gbpchfSmaAndWma.right, gbpchf.getInstrument(), 
52 CandleStickGranularity.W, from, to)); 

53 

54 } 

a 


Name: MovingAverageCalculationServiceDemo 
© main (O= Arguments BA JRE ©» Classpath Ey Source BB Environment [7] Common 
Program arguments: 


https://api-fxtrade.canda.com 
9d 


Variables. 


VM arguments: 


Variables... 
Use the -XstartOnFirstThread argument when launching with SWT 


Working directory: 


© Detour: 


Other: 


Figure 5-4. Launch configuration 


terminated> Moving Average’ 
2e16 

2016-01-27 14:05 iNrO 
2026-01-27 14:05 IMFO xe 
2026-01-27 14:05:36,325 INFO [main] - SMA-2.49198,NMAWL.48256 for instrument-GIP_OHF, 


| 


nel oF ormat~mi dpointhgranvlority-Wkdoi lyAlignser 
om 2815-10-95102:02:02.080+02:08 to 2016-01-19781:08: 00. 000+01:08 


Figure 5-5. Sample output 
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CHAPTER 6 


Placing Orders and Trades 


In this chapter, we turn our attention to arguably the most interesting part of the whole 
trading process, placing orders and trades. An order is an intention to trade. When you 
place an order for a security, you intend that your order is filled and hope that the price 
moves to your advantage. When an order is fully or partly filled, it results in the creation of 
a trading position. An active trading position creates an unrealized profit or loss situation. 
When this trading position is closed, the unrealized profit/loss is realized and the trader is 
left with an increased/decreased total book amount. 

Most of the orders can be classified as one of the following: 


e = Market: A market order is an order meant to be fulfilled instantly 
on the platform at the best available price (spot price), assuming 
that there is enough liquidity in the market. 


e —_ Limit: A limit order is where a trader defines the price he wants 
to buy or sell a security at. In essence, it’s an order to either 
buy below the market price or sell above the market price. For 
example, EUR_USD is currently trading at 1.06. If we believe 
that there is very high probability that in the medium term the 
trajectory is up, but it has still some downside risks, we could 
place a Limit order to, say, buy EUR_USD when the price hits 1.04, 
where we believe the bottom is for this pair. 


e Take Profit: A take-profit order closes an existing trading position 
that has hit a pre-determined profit level. For example, assuming 
we put in a market order to sell GBP_USD @ 1.545, we want to close 
the trading position when the price has moved by at least 200 pips 
in our favor, i.e., the price reaches 1.525. To automatically realize 
the profit, we can place a take-profit order. 


e Stop Loss: A stop-loss order is the opposite of a take-profit order. 
It is an order to limit losses once the price moves adversely and 
the open trading position deteriorates in value. Let’s say we 
put a market order to sell EUR_CHF @ 1.07. However, we want to 
automatically close this position if the price hits 1.085, limiting 
our losses to 150 pips. This is where a stop-loss order comes in 
very handy. 
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Take-profit and stop-loss orders can be classified as derivatives of a limit order. 
Essentially, to realize our profits or to limit our losses, we are placing an order to be 
triggered that will automatically close a trading position. These two types orders are 
defined only if there is an open trading position that risks being closed when these orders 
are triggered. For that to happen, the trading position must be of the opposite type than 
that of the order. For example, we must have an open buy trade position of a security in 
order to trigger a take-profit/stop-loss sell order for the same security. 

Other order types that you might come across are the following: 


e —- Trailing stop 
e Immediate or canceled 


e = Fill or kill 


Order POJO Definition 


To place an order, we must first define a POJO that will hold all the required order 
information. Before that, let’s take a quick look at the enum that defines the different order 
types we are going to support and the enum that defines buy/sell sides of an order. 


1 public enum OrderType { 
2 - MARKET, 

3. LIMIT; 

4} 

5 

6 public enum TradingSignal { 
7 LONG, 

8 SHORT, 

9 NONE ; 

10 

11 public TradingSignal flip() { 
12 switch (this) { 

13 case LONG: 

14 return SHORT; 

15 case SHORT: 

16 return LONG; 

17 default: 

18 return this; 

19 } 

20 } 

21} 


The OrderType enumis fairly straightforward. You might question why we do not 
have the stop-loss or take-profit order types. As discussed earlier, these order types are 
derivatives of a limit order and do not have to be specified differently. This will become 
clear when we discuss the mechanics of placing an order. We denote the buy/sell sides of 
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an order using the TradingSignal enum. This enum, as the name suggests, can be returned 
by a strategy function to indicate that we must buy/sell a security. We will discuss this 
further when we talk about a few sample-trading strategies. 


Listing 6-1. Order POJO Definition 


Ww ON AU BRWN PR 
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37 
38 


/** 

* @param <M> 

bs The type of instrumentId in class TradeableInstrument 
* @param <N> 

. The type of orderId 

* @see TradeableInstrument 

tf 
public class Order < M, N > { 

private final TradeableInstrument < M > instrument; 
private final long units; 

private final TradingSignal side; 

private final OrderType type; 

private final double takeProfit; 

private final double stopLoss; 

private N orderId; 

private final double price; 


j* 

* orderId not included in constructor because normally it is assigned 
* by the platform only after order is placed successfully. 

*/ 

public Order(TradeableInstrument < M > instrument, long units, 
TradingSignal side, OrderType type, 

double price) { 

this(instrument, units, side, type, 0.0, 0.0, price); 


} 


public Order(TradeableInstrument < M > instrument, long units, 
TradingSignal side, OrderType type) { 
this(instrument, units, side, type, 0.0, 0.0); 


} 


public Order(TradeableInstrument < M > instrument, long units, 
TradingSignal side, OrderType type, 

double takeProfit, double stopLoss) { 

this(instrument, units, side, type, takeProfit, stopLoss, 0.0); 


} 


public Order(TradeableInstrument < M > instrument, long units, 
TradingSignal side, OrderType type, 

double takeProfit, double stopLoss, double price) { 
this.instrument = instrument; 
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this.units = units; 
this.side = side; 

this.type = type; 
this.takeProfit = takeProfit; 
this.stopLoss = stopLoss; 
this.price = price; 


} 


public N getOrderId() { 
return orderId; 


} 


public void setOrderId(N orderId) { 
this.orderId = orderId; 


} 


public double getStopLoss() { 
return stopLoss; 


} 


public double getPrice() { 
return price; 


} 


public TradeableInstrument < M > getInstrument() { 
return instrument; 


} 


public long getUnits() { 
return units; 


} 


public TradingSignal getSide() { 
return side; 


} 


public OrderType getType() { 
return type; 


} 


public double getTakeProfit() { 
return takeProfit; 


} 


@O0verride 
public String toString() { 


return "Order [instrument=" + instrument + ", units=" + units + 


side=" + side + 


" 
, 


CHAPTER 6 — PLACING ORDERS AND TRADES 


86 ", type="+ type + ", takeProfit=" + takeProfit + ", stopLoss=" + 
stopLoss + ", orderId=" + 

87 orderId + ", price=" + price + "]"; 

88 } 

89} 


The definition of Order POJO is quite straightforward. The thing to point out is the 
several ways that you can construct the POJO. The simplest is using a constructor with 
minimal information required, like instrument, units, side, and type. This is a classic 
case of placing a vanilla market order (without profit target or stop loss) whereby the 
platform should execute the order straightaway at the best available spot price. On the 
other hand, you can specify the rest of the attributes—takeProfit, stopLoss, and price— 
to place a limit order. Another observation you might make is the default value of 0.0 
that is assigned to, say, the takeProfit and stopLoss attributes while using the simplest 
constructor discussed before. This is an arguable assignment and may pose a problem on 
some platforms, as 0.0 may not be an acceptable default value for not setting a stop loss 
limit. The alternative value preferred could be a null. If this is the case, the POJO definition 
would have to be revised and primitives such as double replaced with Double. 


Order Management Provider Interface 


We now turn our attention to defining the interface that the provider must implement to 
provide some useful order management services like placing and querying orders. This is 
one of the few provider interfaces where we will see all CRUD operations in action. Let’s 
jump straight to the definition of the interface, shown in Listing 6-2. 


Listing 6-2. OrderManagementProvider Interface 


4) j[** 

2 * A provider of CRUD operations for an instrument Order. An order is 

3 * normally placed for a given instrument and/or an accountId. An 
accountId may not be 


4 * required if only a single account is allowed by the platform 

5 * provider, in which case all orders are created in default account. 
6 * 

7 * @param <M> 

8 ba The type of orderId 

9 * @param <N> 

10 . The type of instrumentId in class TradeableInstrument 
11 * @param <K> 

12 bs The type of accountId 

13 * @see TradeableInstrument 

14 at 


15 public interface OrderManagementProvider < M, N, K > { 
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17 /** 

18 * An order is normally of types market or limit. A market order is 

19 * executed straight away by the platform while a limit order is 

20 * executed only if the limit price is hit. Therefore for a limit order 

21 * this method may not return an orderId. 

22 7 

23 * @param order 

24 * @param accountId 

25 * @return a valid orderId if possible. 

26 */ 

27 M placeOrder(Order < N, M > order, K accountId); 

28 

29 /** 

30 * Modify the attributes of a given order. The platform may only 

31 * permit to modify attributes like limit price, stop loss, take 
profit, 

32 * expiration date, units. 

33 + 

34 * @param order 

35 * @param accountId 

36 * @return boolean indicating if the operation was successful. 

37 PY 


38 boolean modifyOrder(Order < N, M > order, K accountId); 
39 


40 /** 

41 * Effectively cancel the order if it is waiting to be executed. A 
valid 

42 * orderId and an optional accountId may be required to uniquely 

43 * identify an order to close/cancel. 

44 . 

45 * @param orderId 

46 * @param accountId 

47 * @return boolean indicating if the operation was successful. 

48 */ 

49 boolean closeOrder(M orderId, K accountId); 

50 

51 /** 

52 : 

53 * @return a collection of all pending orders across all accounts 

54 iy 


55 Collection < Order < N, 
56 M >> allPendingOrders(); 


57 

58 /** 

59 

60 * @param accountId 

61 * @return a collection of all pending orders for a given accountId. 
62 */ 
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63 Collection < Order < N, 
64 M >> pendingOrdersForAccount(K accountId) ; 


65 

66 [et 

67 * 

68 * @param orderId 

69 * @param accountId 

70 * @return Order uniquely identified by orderId and optional 
71 * accountId */ 


72 Order < N, 
73 M > pendingOrderForAccount(M orderId, K accountId) ; 


74 

75 es 

76 - 

77 * @param instrument 

78 * @return a collection of all pending orders for a given instrument 
79 * for all accounts */ 


80 Collection < Order < N, 
81 M >> pendingOrdersForInstrument(TradeableInstrument < N > instrument) ; 
82} 


As you can see, the provider interface provides a rich set of functionality to manage 
orders. Since interface methods are self-explanatory, let’s jump straight into howa 
concrete implementation would look. 


A Concrete Implementation for 
OrderManagementProvider 


Now we come to the fun part where we dive deep into the implementation and discuss 
how we can implement an OANDA provider. Since we are going implement the full set 
of CRUD operations, we need to also get acquainted with the REST verbs that are the 
equivalent of these operations. We already know that HTTP GET equates to R(read). 
What about the rest—C, U, and D? The following table summarizes the http verb used to 
accomplish the actions. 


Operation Http Verb 
Create new order [C] POST 
Query order details [R] GET 
Update existing order [U] PATCH 
Close pending order [D] DELETE 
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With this information at hand, let’s first look at the class definition, including 
the constructor and the JSON keys that are required. We need an AccountProvider 
dependency to be provided, which we will pass in the constructor. The order ID in 
OANDA is a Long. Therefore, substituting Long for an account ID and STRING for an 
instrument ID, we get the following definition: 


1 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
expiry; 

2 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. id; 

3 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 


instrument; 

4 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
orderOpened; 

5 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
price; 

6 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
side; 

7 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
stopLoss; 

8 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
takeProfit; 

9 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
tradeOpened; 

10 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
type; 

11 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
units; 


13. public class OandaOrderManagementProvider implements 
OrderManagementProvider<Long, String, Long> { 


14 

15 private final String url; 

16 private final BasicHeader authHeader; 

17 private final AccountDataProvider<Long> accountDataProvider; 

18 

19 public OandaOrderManagementProvider(String url, String 

accessToken, 

20 AccountDataProvider<Long> accountDataProvider) { 

21 this.url = url; // OANDA REST service base url 

22 this.authHeader = OandaUtils. 
createAuthHeader(accessToken) ; 

23 this.accountDataProvider = accountDataProvider; 

24 } 


Now let’s create the method to place a new order. To place a successful order, we 
must at least provide the minimum order information (using the minimal constructor 
in Order POJO) and a valid account ID. Let’s first look at the function that creates the 
HTTPPost command, which will be later used in the placeOrder function. 
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private static final String ordersResource = "/orders"; 


HttpPost createPostCommand(Order < String, Long > order, Long 
accountId) throws Exception { 

HttpPost httpPost = new HttpPost( 

this.url + OandaConstants.ACCOUNTS RESOURCE + 

TradingConstants.FWD SLASH + accountId + ordersResource) ; 
httpPost.setHeader (this. authHeader) ; 

List < NameValuePair > params = Lists.newArrayList(); 

// Apply proper rounding to price,stop loss, take profit. Oanda 

rejects 0.960000001 


params.add(new BasicNameValuePair(instrument, order.getInstrument(). 
getInstrument())); 

params.add(new BasicNameValuePair(side, OandaUtils.toSide(order. 
getSide()))); 

params.add(new BasicNameValuePair(type, OandaUtils.toType(order. 
getType()))); 

params.add(new BasicNameValuePair(units, String.valueOf(order. 
getUnits()))); 

params.add(new BasicNameValuePair(takeProfit, String.valueOf(order. 
getTakeProfit()))); 

params.add(new BasicNameValuePair(stopLoss, String. valueOf (order. 
getStopLoss()))); 


if (order.getType() == OrderType.LIMIT && order.getPrice() != 0.0) { 
DateTime now = DateTime.now(); 
DateTime nowplus4hrs = now.plusHours(4) ; 
String dateStr = nowplus4hrs.toString(); 
params.add(new BasicNameValuePair(price, String.valueOf(order. 
getPrice()))); 
params.add(new BasicNameValuePair(expiry, dateStr)); 

} 

httpPost.setEntity(new UrlEncodedFormEntity (params) ) ; 

return httpPost; 

} 


We first create an instance of the HttpPost object and pass in the URL to the 


constructor. For example, an url for a valid account ID 123456 would look like this: 


1 


https://api-fxtrade.oanda.com/v1/accounts/123456/orders 


Now that we have an instance of the HttpPost object, we must create a list of 


NameValuePair objects. Each NameValuePair defines an attribute of an order such as 
price. Using the Order POJO, we define all the order attributes. For a LIMIT order we 
must specify a limit price. If we do not provide this price, our order will be rejected by the 
platform. Hence we introduce a special check for a LIMIT order and make sure we have 
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a valid price. While defining the price, we also quickly add an expiry of four hours to the 
order. This means the order will expire automatically on the platform if the limit price is 
not hit. Once all such order attributes are defined via the list of NameValuePair objects, we 
wrap these params/attributes inside an UrlEncodedFormEntity and set it on the instance 
of our HttpPost object. It is always recommended to encode URL parameters. Now we 
are all set to POST these params to the platform. To do this, we return to the placeOrder 
method code. 


1 
2 
3 
4 
5 
6 
7 
8 


Oo 


10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
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@Override 
public Long placeOrder(Order < String, Long > order, Long accountId) { 


CloseableHttpClient httpClient = getHttpClient(); 
try { 
HttpPost httpPost = createPostCommand(order, accountId); 
LOG. info(TradingUtils.executingRequestMsg(httpPost) ); 
HttpResponse resp = httpClient.execute(httpPost) ; 
if (resp.getStatusLine().getStatusCode() == HttpStatus.SC_OK || resp. 
getStatusLine().getStatusCode() == HttpStatus.SC_\ 


CREATED) { 


} 


if (resp.getEntity() != null) { 
String strResp = TradingUtils.responseToString(resp) ; 
Object o = JSONValue.parse(strResp) ; 
JSONObject orderResponse; 
if (order.getType() == OrderType.MARKET) { 
orderResponse = (JSONObject)((JSONObject) o).get(tradeOpened) ; 
} else { 
orderResponse = (JSONObject)((JSONObject) o).get(orderOpened) ; 
} 
Long orderId = (Long) orderResponse. get (OandaJsonKeys. id) ; 
LOG. info("Order executed->" + strResp); 
return orderId; 
} else { 
return null; 
} 
} else { 
LOG.info("Order not executed. http code=" + 
resp.getStatusLine().getStatusCode()); 
return null; 
} 
} catch (Exception e) { 
LOG.warn(e); 
return null; 
} finally { 
TradingUtils.closeSilently(httpClient) ; 
} 
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As described previously, once we have an instance of the HttpPost object, with all 


order attributes set to NameValuePair objects, we are ready to post it to the platform. A 
successful market order post would return a response like the following: 
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{ 

"instrument" : "EUR JPY", 
"time" : "2015-05-261T16:08:51.000000Z", 
"price" : 133.819, 
"tradeOpened" : { 

"id" : 1856110003, 

"units" : 3000, 

"side" : "sell", 

"takeProfit" : 132.819, 

"stopLoss" : 134.9, 

"trailingStop" : 0 

}, 

"tradesClosed" : [], 
"tradeReduced" : {} 
} 


Whereas a successful limit order would return something like this: 


{ 

"instrument" ; "EUR USD", 

"time" : "2015-12-02T06:47:51.000000Z", 

"price" : 1.1, 

"orderOpened" : { 
"id" : 12211080075, 
"units" : 10, 
"side" : "sell", 
"takeProfit" : 1.09, 
"stopLoss” : 1.13, 
"expiry" : "2015-12-02T11:47:39.000000Z", 
"upperBound" : 0, 
"lowerBound" : 0, 
"trailingStop" : 0 


} 


A characteristic of a market order is that, if fully or partially filled, it results in the 


creation of an open position or trade. On the contrary, a limit order results in a creation of 
the order, ready to be triggered if the price level is reached. Therefore we need to interpret 
the response JSON slightly differently depending on what kind of an order was initially 
submitted to the platform. For a market order, we parse the tradeOpened element for the 
order ID, whereas for a limit order, we parse the orderOpened element. Apart from that, 
there is nothing else substantial in the method. 
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Now let’s turn our attention to modifyOrder. Now we can only modify an existing 


limit order since, as per the discussion, only a limit order creates a new pending order. 
A market order on the other hand, results in a trade straightaway. Before looking at the 
code, we need to understand that only certain attributes can be modified for a pending 
order. They are 


e ~=units 
e —_ takeProfit 
e —_stopLoss 


e price 


We need a valid order ID that the placeOrder returned and an account ID to actually 


do the modification. As usual we first focus on the creation of the actual HttpPatch 
command that would facilitate the modification on the platform. 


1 


N 


String orderForAccountUrl(Long accountId, Long orderId) { 

return this.url + OandaConstants.ACCOUNTS_ RESOURCE + TradingConstants. 
FWD SLASH + accountId + 

ordersResource + TradingConstants.FWD SLASH + orderId; 


} 


HttpPatch createPatchCommand(Order < String, Long > order, Long 
accountId) throws Exception { 

HttpPatch httpPatch = mew HttpPatch(orderForAccountUrl1(accountId, 
order.getOrderId())); 

httpPatch.setHeader (this. authHeader) ; 

List < NameValuePair > params = Lists.newArrayList(); 
params.add(new BasicNameValuePair(takeProfit, String.valueOf(order. 
getTakeProfit()))); 

params.add(new BasicNameValuePair(stopLoss, String.valueOf (order. 
getStopLoss()))); 

params.add(new BasicNameValuePair(units, String.valueOf(order. 
getUnits()))); 

params.add(new BasicNameValuePair(price, String.valueOf(order. 
getPrice()))); 

httpPatch.setEntity(mew UrlEncodedFormEntity (params) ) ; 

return httpPatch; 


} 


The creation of the patch command is very similar to the creation of the post 


command that we saw earlier. We create a list of NameValuePair objects and set the 
name/value pairs from the JSON keys/Order POJO, but only those that we are allowed 
to change for a pending order. We also bring into the mix a function to compute the URL 
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to modify the order and other order-related services, which we will soon see and use in 
other places. For account ID 123456 and order 234567, the function would compute as 
follows: 

1 https://api-fxtrade.oanda.com/v1/accounts/123456/orders/234567 


Now turning our attention back to modifyOrder, it looks like this: 


1 @Override 


2 public boolean modifyOrder(Order < String, Long > order, Long 
accountId) { 

3 CloseableHttpClient httpClient = getHttpClient(); 

4 try { 

5 HttpPatch httpPatch = createPatchCommand(order, accountId); 

6 LOG. info(TradingUtils.executingRequestMsg(httpPatch) ); 

7 HttpResponse resp = httpClient.execute(httpPatch) ; 

8 if (resp.getStatusLine().getStatusCode() == HttpStatus.SC OK && 

9 resp.getEntity() != null) { 

10 LOG.info("Order Modified->" + TradingUtils.responseToString(resp)); 

14 return true; 

12 } 

13 LOG.warn(String.format("order %s could not be modified.", 

14 order. toString())); 


15 } catch (Exception e) { 

16 LOG.error(e); 

17 } finally { 

18 TradingUtils.closeSilently(httpClient) ; 


19 } 
20 return false; 
21 ~«+} 


The code looks quite straightforward. Once we have an instance of HttpPatch 
successfully set with all the values, we just post it to the platform. If the order is 
successfully modified, it returns HTTP code 200 in the header and the state of the 
modified order in the response. On receipt of code 200, we return true to indicate 
successful modification; otherwise, we return false. 


#theader 

HTTP/1.1 200 OK 

Server: nginx/1.2.9 
Content-Type: application/json 
Content-Length: 284 


MW PWN PR 


##response body 
{ 


4. 

2 

3 "id": 1001, 
4 "instrument": "USD JPY", 
5 "units": 125, 


109 


CHAPTER 6 — PLACING ORDERS AND TRADES 


6 "side": "sell", 

7 "type": "limit", 

8 "time": "2015-09-22T00:00:00Z", 
9 "price": 122.15, 

0 


1 “takeProfit": 119.25, 

11 "stopLoss": 125.00, 

12 "expiry": "2015-09-251T00:00:00Z", 
13 "upperBound": 0, 

14 "lowerBound": 0, 

15 "trailingStop": 0 

16 =} 


The next one to elaborate on is closeOrder. For deleting or closing an order, 
it is sufficient to send an HttpDelete command to the URL returned by the 
orderForAccountUr1 function. The code to do that is as follows: 


1 @Override 

2 public boolean closeOrder(Long orderId, Long accountId) { 

3 CloseableHttpClient httpClient = getHttpClient(); 

4 try { 

5 HttpDelete httpDelete = new HttpDelete(orderForAccountUrl(accountId, 
orderld)); 

6 httpDelete.setHeader(authHeader) ; 

7 LOG. info(TradingUtils.executingRequestMsg(httpDelete) ) ; 

8 HttpResponse resp = httpClient.execute(httpDelete) ; 

9 if (resp.getStatusLine().getStatusCode() == HttpStatus.SC_OK) { 

0 


1 LOG.info(String.format("Order %d successfully deleted for account 
wd", orderId, accountId)); 

11 return true; 

12 } else { 

13 LOG.warn(String. format ( 

14 "Order %d could not be deleted. Recd error code %d", orderId, resp 

15 -getStatusLine().getStatusCode())); 

16 } 

17 } catch (Exception e) { 

18 LOG.warn("error deleting order id:" + orderId, e); 


19 } finally { 
20 TradingUtils.closeSilently(httpClient) ; 


21 } 
22 return false; 
23. } 


If the order ID and and the account to which it belongs to are both valid, we should 
see an HTTP 200 returned in the header after a successful deletion of the order. 


1  HTTP/1.1 200 OK 


2 Content-Type: application/json 
3 Content-Length: 127 
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Now we turn our attention to implementation of rest of the methods, which are 
all order query methods, and use the old fashioned HttpGet to fetch order related 
information. Let’s jump straight into the first one, pendingOrdersForAccount. This method 
returns a collection of orders that are pending and ready to be filled when the price is hit. 


1 @Override 

2 public Collection < Order < String, Long >> 
pendingOrdersForAccount(Long accountId) { 

return this.pendingOrdersForAccount(accountId, null); 


} 


anu Bw 


private Collection < Order < String, Long >> 
pendingOrdersForAccount(Long accountId, 

7 TradeableInstrument < String > instrument) { 

8 Collection < Order < String, Long >> pendingOrders = Lists. 


newArrayList(); 
9 CloseableHttpClient httpClient = getHttpClient(); 
10 try { 
11 HttpUriRequest httpGet = new HttpGet(this.url + 
12 OandaConstants.ACCOUNTS RESOURCE + TradingConstants.FWD SLASH + 


accountId + ordersResource + (instrument != null ? "?\ 
13. instrument=" + instrument.getInstrument() : 
14 StringUtils.EMPTY)); 
15 httpGet . setHeader (this. authHeader) ; 
16 httpGet .setHeader(OandaConstants.UNIX_DATETIME_ HEADER); 
17 LOG. info(TradingUtils.executingRequestMsg(httpGet) ) ; 
18 HttpResponse resp = httpClient.execute(httpGet) ; 
19 String strResp = TradingUtils.responseToString(resp) ; 
20 if (strResp != StringUtils.EMPTY) { 


21 Object obj = JSONValue.parse(strResp) ; 

22 JSONObject jsonResp = (JSONObject) obj; 

23 JSONArray accountOrders = (JSONArray) jsonResp.get(orders) ; 
24 

25 for (Object 0: accountOrders) { 

26 JSONObject order = (JSONObject) 0; 

27 Order < String, Long > pendingOrder = parseOrder(order); 
28 pendingOrders.add(pendingOrder) ; 

29 } 

30 } else { 

31 TradingUtils.printErrorMsg (resp) ; 

32 } 


33 } catch (Exception e) { 

34 LOG.error(e); 

35 } finally { 

36 TradingUtils.closeSilently(httpClient) ; 


37, J 
38 return pendingOrders; 
go 
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The public method delegates to an internal private method that retrieves pending 
orders for an account and optionally filters for an instrument if provided. Since we want 
all orders irrespective of instrument, we pass a null for an instrument to this method. 
Let’s take a closer look at the code that generates this URL with or without an instrument 
value passed in. 


1 this.url + OandaConstants.ACCOUNTS RESOURCE + TradingConstants.FWD SLASH 
+ accountId 

2 + ordersResource + (instrument != null ? "?instrument=" 

3 ++ instrument.getInstrument() : StringUtils.EMPTY 
If instrument is null then the output for account ID 123456 would be: 

1  https://api-fxtrade.oanda.com/v1/accounts/123456/orders 


But ifan instrument EUR_USD is passed in, we get this result: 


1 https://api-fxtrade.oanda.com/v1/accounts/123456/orders?instrument=EUR_ 
USD 


A sample JSON that would be returned when we ask for all orders looks like this: 


1 { 

2 "orders": [ 

3 i 

4 "id": 1001, 

5 "instrument": "USD CAD", 

6 "units": 100, 

7 "side": "buy", 

8 "type": "marketIfTouched", 
9 "time": "1444116207000000", 
10 "price": 1.3, 

11 “takeProfit": 1.31, 

12 "stopLoss": 1.2, 

13 "expiry": "1444721003000000", 
14 "upperBound": 0, 

15 "lowerBound": 0, 

16 "trailingStop": 0 

17 }; 

18 { 

19 "id": 1002, 

20 "instrument": "EUR USD", 
21 "units": 150, 
22 "side": "buy", 
23 "type": "marketIfTouched", 
24 "time": "1444108460000000", 
25 "price": 1.115, 
26 “takeProfit": 0, 
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"stopLoss": 0, 

"expiry": "1444713259000000", 
"upperBound": 0, 
"lowerBound": 0, 
"trailingStop": 0 

} 
] 
} 


Now what remains is to parse this response into a collection of orders, which this 


method is contracted to return. The parseOrder private method does that for us for each 
order element in the JSON orders array. 


1 
2 
3 
A 


12 
13 
14 
15 


private Order < String, Long > parseOrder(JSONObject order) { 

final String orderInstrument = (String) order.get(instrument) ; 

final Long orderUnits = (Long) order.get(units); 

final TradingSignal orderSide = OandaUtils.toTradingSignal( (String) 

order.get(side)); 

final OrderType orderType = OandaUtils.toOrderType((String) order. 

get(type)); 

final double orderTakeProfit = ((Number) order.get(takeProfit)). 

doubleValue(); 

final double orderStopLoss = ((Number) order.get(stopLoss)). 

doubleValue(); 

final double orderPrice = ((Number) order.get(price)).doubleValue(); 

final Long orderId = (Long) order.get(id); 

Order < String, Long > pendingOrder = new Order < String, Long > ( 
new TradeableInstrument < String > (orderInstrument), orderUnits, 
orderSide, orderType, 
orderTakeProfit, orderStopLoss, orderPrice) ; 

pendingOrder.setOrderId(orderId) ; 

return pendingOrder; 


} 


The next one we turn our attention to is the pendingOrdersForInstrument 


method. The mandate for this method is to find all orders across all accounts for a given 
instrument. We already have seen that we have a private method, which can return all 
orders for a given account and an instrument if provided. Therefore, what we need to do 
is get a list of all accounts that the trading account has and loop for each account and call 
this internal method to retrieve all orders. This is pretty much what this code does: 


1 
2 


3 


4 


@Override 
public Collection < Order < String, Long >> pendingOrdersForInstrument 
(TradeableInstrument < String > instrument) { 


Collection < Account < Long >> accounts = this.accountDataProvider. 
getLatestAccountInfo(); 
Collection < Order < String, Long >> allOrders = Lists.newArrayList(); 
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5 for (Account < Long > account: accounts) { 


6 all0rders.addA11(this.pendingOrdersForAccount(account.getAccountId(), 
instrument) ); 

7 3 

8 return allOrders; 

9 } 


The implementation of this code paves the way for a very straightforward 
implementation of the allPendingOrders method: 


@Override 

public Collection<Order<String, Long>> allPendingOrders() { 
return pendingOrdersForInstrument (nul1) ; 

} 


BWN PRP 


The last one left on our plate to describe is the pendingOrderForAccount method. 
This method retrieves a single order for a given account if we provide the precise order ID. 
This method calls the orderForAccountUr1 to return the URL to request the information 
from. This method was called previously when we tried to modify an existing order using 
HttpPatch. This time we just need to use a different HTTP verb, HttpGet, to retrieve the 
order information from the same URL. A sample JSON response looks like this: 


1, 4 

2 "id": 1001, 

3 "instrument": "USD JPY", 

4 "units": 125, 

5 "side": "sell", 

6 "type": "marketIfTouched", 
7 "time": "1444116207000000", 
8 "price": 122.15, 

9 “takeProfit": 119.25, 
10 "stopLoss": 125.00, 
11 "expiry": "1444721003000000", 
12 “upperBound": 0, 
13 “lowerBound": 0, 
14 "trailingStop": 0 
15 } 


The code that initiates this kind of response is as follows: 


@Override 

2 public Order < String, Long > pendingOrderForAccount(Long orderId, Long 
accountId) { 

3 CloseableHttpClient httpClient = getHttpClient(); 


4 try { 
5 HttpUriRequest httpGet = new HttpGet (orderForAccountUrl(accountId, 
orderlId)); 


6 httpGet . setHeader (this. authHeader) ; 
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7 httpGet .setHeader(OandaConstants.UNIX_DATETIME HEADER); 

8 LOG. info(TradingUtils.executingRequestMsg(httpGet) ) ; 

9 HttpResponse resp = httpClient.execute(httpGet) ; 

10 String strResp = TradingUtils.responseToString(resp) ; 

11 if (strResp != StringUtils.EMPTY) { 

12 JSONObject order = (JSONObject) JSONValue.parse(strResp) ; 
13 return parseOrder (order) ; 

14 } else { 

15 TradingUtils.printErrorMsg (resp) ; 

16 } 


17 } catch (Exception e) { 

18 LOG.error(e); 

19 } finally { 

20 TradingUtils.closeSilently(httpClient) ; 


21 } 
22 return null; 
23} 


With this, we conclude our discussion of all the methods that 
OandaOrderManagement- Provider provides for order management services. 


A Simple OrderlnfoService 


In keeping with the theme of encapsulating our provider methods behind a service, we 
need to code an OrderInfoService that encapsulates all the read-only methods of the 
OrderManagementProvider. It is fairly straightforward and reads as follows: 


public class OrderInfoService < M, N, K > { 


1 

2 

3 private final OrderManagementProvider < M, 

4 N, 

5 K > orderManagementProvider; 

6 

7 public OrderInfoService(OrderManagementProvider < M, N, K > 


orderManagementProvider) { 
8 this.orderManagementProvider = orderManagementProvider; 


9 } 


11 public Collection < Order < N, 

12 M >> allPendingOrders() { 

13 return this.orderManagementProvider.allPendingOrders(); 
14 } 


16 public Collection < Order < N, 

17 M >> pendingOrdersForAccount(K accountId) { 

18 return this. orderManagementProvider .pendingOrdersForAccount (accountId) ; 
19} 
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20 

21 public Collection < Order < N, 

22 M >> 

23 pendingOrdersForInstrument(TradeableInstrument < N > instrument) { 

24 return this.orderManagementProvider.pendingOrdersForInstrument 
(instrument) ; 

25} 

26 


27 public Order < N, 
28 M > pendingOrderForAccount(M orderId, K accountId) { 


29 return this .orderManagementProvider .pendingOrderForAccount(orderId, 
accountId); 

30— SK 

31 


32 public int findNetPositionCountForCurrency(String currency) { 
33 Collection < Order < N, M >> allOrders = allPendingOrders(); 


34 int positionCount = 0; 

35 for (Order < N, M > order: allOrders) { 

36 positionCount += 

37 TradingUtils.getSign(order.getInstrument().getInstrument(), 
38 order.getSide(), currency); 

39 } 

40 return positionCount; 

41 } 

42. } 


All the methods except findNetPositionCountForCurrency delegate to the 
underlying Order-ManagementProvider to fulfill the requested information. Therefore, 
what remains to be discussed is the findNetPositionCountForCurrency method. Taking 
a closer look at the method code; it requests for all the pending orders across all accounts 
and calculates the net position for a currency by looking at the sign (-1 or +1) returned 
from the TradingUtils.getSign method. Recall that this method returns a -1 if we are 
selling the given currency or +1 if we are buying it. For example, if we sell the pair EUR_CHF 
by placing a limit order, passing the currency EUR would yield -1 and CHF +1. 

Using the findNetPositionCountForCurrency method is not immediately apparent. 
However, it is quite useful from a risk-management perspective, which we discuss in later 
chapters, in order to know how much long or short we are on a given currency. 


Validating Orders Before Execution: 
PreOrderValidationService 


Before we turn our attention to discussing the service that encapsulates the order 
execution, modification, and deletion part, we discuss an important service that does 
some preorder execution checks, and only if those checks succeed, that an order is 
executed. This again is purely in place from a risk-management perspective and can 
be bypassed if needed. We will discuss in later chapters why it is important to have 
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risk-management controls in place, especially on highly leveraged accounts. However, 
for our discussion, I came up with some rules or checks that must be done in order to 
give a green light to the order execution. These set of checks might not be sufficient for 
all cases, but the point is that we must do some due diligence upfront, before placing an 
order. The rules I came up with are as follows: 


e Be overweight or underweight by a currency only up to a given 
level. This is to say that, you must have both long and short 
positions for, say, AUD, and if you do have net long or short 
positions, they must not exceed a given configurable number, say 
4. So, if you already have four open trades like long AUD_USD, long 
AUD_CHF, short GBP_AUD, and short EUR_AUD, that means we 
are quite heavyweight with AUD, so any further long AUD positions 
must be rejected. For example, if a strategy recommends placing a 
market order for long AUD_JPY, this order must be rejected, as the 
mandate is not to exceed a long or short position if it is already at 
max level, four in this case. 


e Donottradea currency pair ifits 10-year weighted moving 
average (WMA) is within x% of its historical high or low. This 
needs a bit of explanation. Let’s say the 10-year WMA of EUR_USD 
is 1.3 and the current spot price is 1.08. You should be extremely 
reluctant to place a short EUR_USD order at this level. This is 
because, according to the rule, you can only go short, up to 10% 
(assuming x=10) of the 10-year WMA. So subtracting 10% of 1.3 
from 1.3 gives 1.17. So if the price dips below that, the check will 
not allow to place a short EUR_USD order. Similarly, you could 
not go long EUR_USD if the current price is 1.45 (it is greater than 
1.3+10% of 1.3 = 1.43). 


e Don’t place an order if an existing trade with the pair is already 
active. This is to ensure that you do not accidentally close/reduce 
an existing trading position by placing an order in the opposite 
direction or add to an existing position and double up on a trade. 


These rules of course may not make complete sense and may go against the advice 
of your winning strategy, but the point is to have some sort of pre-validation rules that 
do not unnecessarily increase the risk in your portfolio. Of course, you are welcome to 
completely trash these rules and write your own. As long as you have some meaningful 
set of rules/checks, they always help you in the long run. 

Now let’s jump straight into the code, which attempts to program these rules in the 
service. We begin first by defining the constructor that accepts all the dependencies of 
this service. 


1 public class PreOrderValidationService < M, N, K > { 
2 private final TradeInfoService < M, 

3 N, 

4 K > tradeInfoService; 

5 private final MovingAverageCalculationService < N > 
6 movingAverageCalculationService; 
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7 private final BaseTradingConfig baseTradingConfig; 
8 private final OrderInfoService < M, 

9 N, 
0 


1 K > orderInfoService; 

11 static final int TEN_YRS_IN MTHS = 120; 

12 

13 public PreOrderValidationService(TradeInfoService < M, N, K > 
tradeInfoService, 

14 MovingAverageCalculationService < N > 
movingAverageCalculationService, 

15 BaseTradingConfig baseTradingConfig, 

16 OrderInfoService < M, N, K > orderInfoService) { 

17 this.tradeInfoService = tradeInfoService; 

18 this .movingAverageCalculationService = 
movingAverageCalculationService; 

19 this.baseTradingConfig = baseTradingConfig; 

20 this.orderInfoService = orderInfoService; 

21} 


The TradeInfoService is something we will cover later in this chapter. The methods 
invoked to obtain various trade-related information are pretty self-explanatory in the 
current context but will be elaborated on later. The rest, I believe, follow naturally from 
our discussion of the validation rules. MovingAverageCalculationService is required 
for computation of the WMA, the BaseTradingConfig is for various configuration 
parameters, like maximum allowed net positions for a currency, and OrderInfoService 
is for information regarding pending orders. 

Let’s now look at the service method that codes the first validation check in our list. 


1 public boolean checkLimitsForCcy(TradeableInstrument < N > instrument, 
TradingSignal signal) { 
String currencies[] = TradingUtils.splitInstrumentPair(instrument. 
getInstrument()); 
for (String currency: currencies) { 
int positionCount = 
this. tradeInfoService. findNetPositionCountForCurrency(currency) + 
this. orderInfoService. findNetPositionCountForCurrency (currency) ; 
int sign = TradingUtils.getSign(instrument.getInstrument(), signal, 
currency) ; 
int newPositionCount = positionCount + sign; 
if (Math.abs(newPositionCount) > 
11 this. baseTradingConfig.getMaxAllowedNetContracts() && Integer. 
signum(sign) == Integer.signum(positionCount)) { 
12 LOG.warn(String. format ( 
13 "Cannot place trade %s because max limit exceeded. max allowed=%d 
and " + "current net positions=%d for currency %s"\ 
14 +, instrument, 
15 this. baseTradingConfig.getMaxAllowedNetContracts(), 
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16 newPositionCount, currency)); 
17 return false; 

18 } 

19 } 

20 return true; 

21 ~«+} 


This method returns a false if the check fails; otherwise, it returns true. The 
method begins by first splitting the currency pair into individual currencies and, for each 
currency, getting the current state of affairs, i.e., the sum of all open trading positions 
and pending orders. This we call the current position count. So if we have four sell CHF 
trading positions and one pending order to buy CHEF, our net position count would be -3. 
(Remember that negative numbers denote a sell position.) Therefore, if we want to place 
anew market order to buy USD_CHF, the TradingUtils.getSign would return -1 for CHF. 
This would increase our short CHF positions to 4 if we were to go ahead with this order. 
Now the evaluation of the check happens in this part of the code. 


1 if (Math.abs(newPositionCount) > 


2 this. baseTradingConfig. 
getMaxAllowedNetContracts() && 
3 Integer.signum(sign) == Integer.signum(positionCount)) { 


If the maximum allowed net contracts for each currency is configured as 4, we are 
still in a position to place this market order, as the new position count will then take it to 
the maximum allowed level. Since we are actually comparing the absolute value as part 
of the if statement, we must also add the sign check to make sure that the future position 
count has the same sign as the sign returned by TradingUtils.getSign. 

Now let’s look at the service method code for our second validation check. 


ry 


public boolean isInSafeZone(TradingSignal signal, double price, 
TradeableInstrument < N > instrument) { 
double wma10yr = this.movingAverageCalculationService.calculateWMA( 
instrument, TEN_YRS IN MTHS, 
CandleStickGranularity.M) ; 
final double max10yrWma0ffset = baseTradingConfig. 
getMax1oyrWma0ffset() ; 
6 double minPrice = (1.0 - max10yrWmaOffset) * wma10yr; 
7 double maxPrice = (1.0 + max10yrWmaOffset) * wma1oyr; 
8 if ((signal == TradingSignal.SHORT && price > minPrice) || (signal == 
TradingSignal.LONG && price < 
9 maxPrice)) { 
10 return true; 
11 } else { 
12 LOG. info(String. format ( 
13 "Rejecting %s %s because price %2.5f is 10pct on either side of wma 
10yr 
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14 price of 42.5 f ", 

15 signal, instrument, price, wmaloyr)); 
16 return false; 

17 i} 

18} 


We begin by calculating the 10-year WMA for this instrument by 
passing monthly granularity as an input parameter. The value returned by 
movingAverageCalculationService.calculateWMA is the basis for our safe zone 
calculation. Assuming the value of getMax10yrWmaOffset is configured as 0.1 (10%), our 
safe zone then becomes 10% on either side of this value. What that means is that we are 
willing to place a short order only if the price fall from this value is less than or equal to 
10%. Similarly, we are willing to place a long order only if the price increase is less than or 
equal to 10%. Since this value is configurable, we can always broaden our safe zone. 

Now for the last validation check from our discussion, the method code is as follows: 


1 public boolean checkInstrumentNotAlreadyTraded(TradeableInstrument < N 
> instrument) { 
2 Collection < K > accIds = this.tradeInfoService. findAllAccountsWithIns 
trumentTrades (instrument) ; 
3 if (accIds.size() > 0) { 
4 LOG.warn(String.format("Trade with instrument %s as one already 
exists", instrument)); 


5 return false; 

6 } else { 

7 Collection < Order < N, M >> pendingOrders = this.orderInfoService. 

8 pendingOrdersForInstrument (instrument) ; 

9 if (!pendingOrders.isEmpty()) { 

10 LOG.warn(String.format("Pending order with instrument %s already 
exists", instrument)); 

11 return false; 

12 } 

13 return true; 

14 } 

15} 


Our method begins by calling on TradeInfoService to check if there are any 
accounts that have an open trade position for the given instrument. If we do have any, 
then we straightaway exit the method returning false. However, if no such accounts 
exist, we check if there are any pending orders for the given instrument. If we do find 
any pending orders, we again return false from the method or we return true. With this 
we conclude our discussion of the service to pre-validate orders. The next logical step 
is to move on TO the actual service, which places these orders after all the checks pass. 
Remember that although some of these validation checks do not arguably fit in the grand 
scheme of things, at least we all agree that we need to have a set of checks before we are 
absolutely sure that an order needs to be placed. 
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Putting It All Together in an 
OrderExecutionService 


We conclude our discussion of order-management services by diving deep into the 
OrderExecutionService. The design of this service is based on a queue, where orders 
are picked up. After all the checks pass, an order is sent to the platform. The idea is that, 
from our various strategies and maybe from other services, we can simply drop the order 
in a queue and rest is taken care of by this service, which is listening on this queue for 
new orders. By doing this, we have decoupled the act of arriving at a decision to place 

an order (based on a trading signal that our strategy has advised) for a given instrument 
and the mechanics of placing the order. Let’s begin by looking at the constructor and the 
dependencies that it expects. 


1 public class OrderExecutionService < M, N, K > implements Runnable { 


3 private static final Logger LOG = Logger. 
getLogger (OrderExecutionService.class) ; 


4 

5 private final BlockingQueue < TradingDecision < N >> orderQueue; 

6 private final AccountInfoService < K, N > accountInfoService; 

7 private final OrderManagementProvider < M, N, K > 
orderManagementProvider; 

8 private final BaseTradingConfig baseTradingConfig; 

9 private final PreOrderValidationService < M, N, K > 
preOrderValidationService; 

10 private final CurrentPriceInfoProvider < N > 
currentPriceInfoProvider; 

11 private volatile boolean serviceUp = true; 

12 Thread orderExecThread; 

13 

14 public OrderExecutionService(BlockingQueue < TradingDecision < N >> 
orderQueue, 

15 AccountInfoService < K, N > accountInfoService, 

16 OrderManagementProvider < M, N, K > 

17 orderManagementProvider, BaseTradingConfig baseTradingConfig, 

18 PreOrderValidationService < M, N, K > preOrderValidationService, 

19 CurrentPriceInfoProvider < N > currentPriceInfoProvider) { 

20 this.orderQueue = orderQueue; 

21 this.accountInfoService = accountInfoService; 

22 this.orderManagementProvider = orderManagementProvider; 

23 this.baseTradingConfig = baseTradingConfig; 

24 this. preOrderValidationService = preOrderValidationService; 

25 this.currentPriceInfoProvider = currentPriceInfoProvider; 

26 } 
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27 
28 
29 
30 
31 


@PostConstruct 

public void init() { 

orderExecThread = new Thread(this, this.getClass().getSimpleName()); 
orderExecThread.start(); 


The first thing we notice is that our service implements the Runnable interface, 


which suggests that this service is going to spawn a thread to continuously monitor the 
order queue. The thread is initialized in the init method, which is automatically invoked 
by a DI framework like Spring once the application context is initialized (due to the @ 
PostConstruct annotation), or needs to be explicitly called if we are not using one. In 

our thread, we continuously monitor the order queue for a new order. Once an order 

is received from the queue, we bring these dependencies into play (the use of each will 
become evident soon). Let’s look at the run method where all the action seems to happen. 


1 
2 
3 
4 
5 
6 
7 
8 
9 
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@Override 
public void run() { 
while (serviceUp) { 


try { 


TradingDecision < N > decision = this.orderQueue.take(); 
if (!preValidate(decision)) { 
continue; 
} 
Collection < K > accountIds = this.accountInfoService. 
findAccountsToTrade(); 
if (accountIds.isEmpty()) { 
LOG.info("Not a single eligible account found as the reserve may 
have been exhausted. 
")3 
continue; 
} 
Order < N, M > order = null; 
if (decision.getLimitPrice() == 0.0) { // market order 
order = new Order < N, M > (decision.getInstrument(), 
this. baseTradingConfig.getMaxAllowedQuantity(), decision. 
getSignal(), 
OrderType.MARKET, decision.getTakeProfitPrice(), 
decision.getStopLossPrice()); 
} else { 
order = new Order < N, M > (decision.getInstrument(), 
this. baseTradingConfig.getMaxAllowedQuantity(), decision. 
getSignal(), 
OrderType.LIMIT, 
decision.getTakeProfitPrice(), decision.getStopLossPrice(), 
decision.getLimitPrice()); 
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for (K accountId: accountIds) { 
M orderId = this.orderManagementProvider.placeOrder (order, 
accountId); 
if (orderId != null) { 
order.setOrderId(orderId); 
} 
break; 
} 
} catch (Exception e) { 
LOG.error(e); 
} 


} 


private boolean preValidate(TradingDecision < N > decision) { 
if (TradingSignal.NONE != decision.getSignal() && 
this. preOrderValidationService.checkInstrumentNotAlreadyTraded( 
decision.getInstrument()) && 
this. preOrderValidationService.checkLimitsForCcy ( 
decision.getInstrument(), decision.getSignal())) { 
Collection < TradeableInstrument < N >> instruments = Lists. 
newArrayList(); 
instruments.add(decision.getInstrument()); 
Map < TradeableInstrument < N > , Price < N >> priceMap = 
this. currentPriceInfoProvider.getCurrentPricesForInstruments (instru 
ments) ; 
if (priceMap.containsKey(decision.getInstrument())) { 
Price < N > currentPrice = priceMap.get(decision.getInstrument()); 
return this.preOrderValidationService.isInSafeZone(decision. 
getSignal(), 
decision.getSignal() == 
TradingSignal.LONG ? currentPrice.getAskPrice() : currentPrice. 
getBidPrice(), 
decision.getInstrument()); 
i 
} 
return false; 


} 


Our run method will forever loop until the value of the volatile variable serviceUp 


is set to false. 


We will come back to how to set this to false shortly to terminate the loop, and 


as a consequence the method that results in the termination of the thread. The this. 
orderQueue.take() statement blocks until an order is available in the queue to be 
processed. Assuming an order is available and taken off the queue, the first thing we do is 
make sure that it passes our series of validation checks in the preValidate method. This 
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method just applies all the three validation checks we discussed in the previous section, 
but if we look carefully, it actually does an optimization. Since doing the safe zone checks 
requires a fetch of the last 10 years’ worth of candlesticks data, this is only done if the 
other two checks pass. 

Assuming our checks succeed, we now need to find accounts with which we can 
trade. Now if you recall the discussion about selecting accounts eligible for trade, there 
were also a set of checks that need to pass before an account is deemed eligible to trade, 
for instance, the amount available must be at least x% of the total amount. Again, you can 
call it a second level of checks, based on the account level. If no accounts are available, 
we leave the rest of the processing and go back to the start of the while loop. However, if 
we do find at least one account, we are now ready to place the order. To do so, we must 
first prepare an Order POJO from the TradingSignal instance that we picked up from the 
queue. 

The first thing to decide is whether it’s a market or a limit order. Reminding ourselves 
that a limit order must have a trigger price set, we check if the trading decision has a 
trigger price set. If it is set, then we prepare the Order POJO as type LIMIT; otherwise, it’s 
a MARKET order. Now that we have a fully primed Order POJO to be sent across to place 
the order, we loop over all the eligible accounts that we have. As soon as we find the first 
one with which we are successful at placing the order (a valid orderId is returned when 
an order is placed successfully), we break out of the loop and then go back again to the 
beginning of the loop. 

Coming back to the point, which was how the variable serviceUp can be set to false 
so that the thread can stop. For this we create a shutdown hook in the service, which 
again is invoked automatically by a DI framework when the application is being shut 
down. The magic happens due to the annotation @PreDestroy, which these frameworks 
deem as methods to be called before destroying the bean. Again if we are not using a DI 
framework, then one has to manually call the shutdown() method externally to terminate 
the thread. 


@PreDestroy 
public void shutDown() { 
this.serviceUp = false; 


} 


BWNP 


With this we conclude our discussion about most of the stuff that you need to know 
about orders. Now it’s time to turn our attention to what happens when these orders are 
executed and result in the creation of a trading position. A trading position equates to risk 
in your portfolio, and you must be ready to manage this position in order to minimize 
losses and maximize profits. We begin our detailed discussion by defining the Trade 
POJO. 


Trade POJO Definition 


The Trade POJO, like Order POJO, holds all the necessary information to manage trades 
and describe open trading positions in the system. As we will see, the two POJOs have 
lots of attributes in common, simply because an order, when executed, translates into 
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an open position. Like an order, a trade must have an underlying instrument, stop-loss 
price, take-profit price, buy/sell side, etc. Let’s discover the Trade POJO in more detail by 


looking at this code: 
7 /** 
2 * 
3 * @param <M> The type of tradelId 
4 * @param <N> The type of instrumentId in class TradeableInstrument 
5 * @param <K> The type of accountId 
6 * @see TradeableInstrument 
7 wf 
8 public class Trade < M, N, K > { 
9 private final M tradelId; 
10 private final long units; 
11 private final TradingSignal side; 
12 private final TradeableInstrument < N > instrument; 
13 private final DateTime tradeDate; 
14 private final double takeProfitPrice, 
15 executionPrice, 
16 stopLoss; 
17 private final K accountId; 
18 private final String toStr; 
19 
20 public Trade(M tradeId, long units, TradingSignal side, 
21 TradeableInstrument < N > instrument, DateTime tradeDate, double 
takeProfitPrice, 
22 double executionPrice, double stopLoss, K accountId) { 
23 this.tradeId = tradelId; 
24 this.units = units; 
25 this.side = side; 
26 this.instrument = instrument; 
27 this.tradeDate = tradeDate; 
28 this.takeProfitPrice = takeProfitPrice; 
29 this.executionPrice = executionPrice; 
30 this.stopLoss = stopLoss; 
31 this.accountId = accountId; 
32 this.toStr = String. format ( 
33 "Trade Id=%d, Units=%d, Side=%s, Instrument=%s, TradeDate=%s, 
TP=%3.5f, 
34 Price = %3.5 f, SL=%3.5 f", 
35 tradeId, units, side, instrument, tradeDate.toString(), 
takeProfitPrice, 
36 executionPrice, stopLoss); 
37 } 
38 
39 @Override 
40 public int hashCode() { 
41 final int prime = 31; 
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int result = 1; 

result = prime * result + ((accountId == null) ? 0 : accountId. 
hashCode()); 

result = prime * result + ((tradeId == null) ? 0 : tradeld. 
hashCode()); 

return result; 


} 


@Override 
public boolean equals(Object obj) { 
if (this == obj) 
return true; 
if (obj == null) 
return false; 
if (getClass() != obj.getClass()) 
return false; 
@SuppressWarnings ("unchecked") 
Trade < M, N, K > other = (Trade < M, N, K > ) obj; 
if (accountId == null) { 
if (other.accountId != null) 
return false; 
} else if (!accountId.equals(other.accountId) ) 
return false; 
if (tradeId == null) { 
if (other.tradeId != null) 
return false; 
} else if (!tradeId.equals(other.tradeId)) 
return false; 
return true; 


} 


public double getStopLoss() { 
return stopLoss; 


} 


public K getAccountId() { 
return accountId; 


} 


@Override 
public String toString() { 
return toStr; 


} 


public double getExecutionPrice() { 
return executionPrice; 


} 
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public M getTradeld() { 
return tradeld; 


} 


public long getUnits() { 
return units; 


} 


public TradingSignal getSide() { 
return side; 


} 


public TradeableInstrument < N > getInstrument() { 
return instrument; 


} 


public DateTime getTradeDate() { 
return tradeDate; 


} 


public double getTakeProfitPrice() { 
return takeProfitPrice; 

} 

i 


Looking at this code, note that it bears quite a bit of resemblance to the Order POJO 


in terms of the attributes. Apart from that, the POJO looks fairly simply. Hence, we can 
move on to the discussion of the trade management provider interface definition. 


Trade Management Provider Interface 


Just like its cousin, OrderManagementProvider, TradeManagementProvider has very 
similar actions except one notable one. From the CRUD set of operations, the provider 
provides all except the C. This is because only an order placed and filled can create a 
trade and you can only then modify, close, or retrieve information regarding the trade. 
Let’s move straight to its definition: 


Ww ON AU HBPWN KE 


= 
oO 


{* 


a a 


* 


A provider of RUD operations on a single Trade. Normally Trades 

are grouped under an account, so in order to perform these 
operations, a valid accountId is normally required. Some providers 
may just have the concept of a single account, so any operation on 
the Trade may always default to that single account, in which case 
the accountId may be null. 

A bulk operation to closeAll trades is deliberately left out to avoid 
potential misuse. 
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* @param <M> The type of tradeId 
* @param <N> The type of instrumentId in class TradeableInstrument 
* @param <K> The type of accountId 
* @see TradeableInstrument 
*/ 
public interface TradeManagementProvider < M, N, K > { 
/** 
* Modify an existing trade by providing accountId and tradeId to 
* identify the trade. In some cases the tradeId may be sufficient to 
* identify the trade and therefore accountId may be null. Only 
* stopLoss and takeProfit parameters for the trade can be modified 
* through this operation. 
* @param accountId 
* @param tradeld 
* @param stopLoss 
* @param takeProfit 
* @return boolean to indicate whether the modification was 
* successful or not. 
*/ 
boolean modifyTrade(K accountId, M tradeId, double stopLoss, double 
takeProfit) ; 


/** 

* Close an existing trade by providing accountId and tradeId to 
* identify a given trade. Again, the accountId may be optional to 
* close the trade 
* @param tradeId 
* @param accountId 
* @return boolean to indicate when the trade was successfully 
* closed or not. 

*/ 
boolean closeTrade(M tradeId, K accountId); 


/** 
* Retrieve trade for the given tradeId and/or accountId 
* 
* @param tradeld 
* @param accountId 
* @return a Trade or null if not found. 
*/ 
Trade < M, 
N, 
K > getTradeForAccount(M tradeId, K accountId); 


/** 
* All Trades for a given account or an empty collection if none 


* found. The ordering of trades such as by instruments or in 
* chronological order is not guaranteed. 
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58 i 

59 * @param accountId 

60 * @return a Collection of trades for the given account Id. 
61 */ 

62 Collection < Trade < M, 

63 N, 

64 K >> getTradesForAccount(K accountId) ; 

65 } 


This looks remarkably similar, right? Except of course a missing placeTrade method, 
the reason for which we discussed earlier. 


A Concrete Implementation for 
TradeManagementProvider 


The OANDA API implementation OandaTradeManagementProvider has lots of things in 
common with its Order implementation counterpart, as you might expect. Since a lot of 
the discussion around the Order implementation applies to the Trade implementation, 
we will just jump straight into the code and point out any differences if applicable. Apart 
from that, most of the principles applicable to the Order implementation are applicable 
here. We begin as usual by defining the provider class, its constructor, and the JSON keys 
used: 


1 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. id; 
2 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 


instrument; 

3 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
price; 

4 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
side; 

5 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
stopLoss; 

6 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
takeProfit; 

7 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
time; 

8 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
trades; 

9 import static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 
units; 


11 public class OandaTradeManagementProvider implements 
TradeManagementProvider < Long, String, Long > { 


12 private final String url; 
13 private final BasicHeader authHeader; 
14 
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15 public OandaTradeManagementProvider(String url, String accessToken) { 
16 this.url = url; 

17 this.authHeader = OandaUtils.createAuthHeader(accessToken) ; 

18} 


As seen from this listing, the constructor has one less dependency of 
AccountDataProvider compared to the Order counterpart. We can appreciate this 
difference, as a trading position is already attached to an account, while for an Order, we 
can choose which account we want to use. To fetch the list of available accounts, we need 
the services of AccountDataProvider. The rest of the stuff is fairly straightforward and we 
can progress to the definition of modifyTrade. Remember that you can only modify the 
following attributes of a trade: 


e =takeProfit 


e —stopLoss 


1 private static final String tradesResource = "/trades"; 

2 

3 String getTradeForAccountUrl(Long tradeId, Long accountId) { 

4 return this.url + OandaConstants.ACCOUNTS RESOURCE + 

5 TradingConstants.FWD SLASH + accountId + tradesResource + 
TradingConstants.FWD SLASH + tradelId; 

6 } 

7 


8 HttpPatch createPatchCommand(Long accountId, Long tradeId, double 
stopLoss, double takeProfit) 

9 throws Exception { 

10 HttpPatch httpPatch = mew HttpPatch(getTradeForAccountUrl(tradeld, 


accountId)); 
11 httpPatch.setHeader (this. authHeader) ; 
12 List < NameValuePair > params = Lists.newArrayList(); 


13 params.add(new BasicNameValuePair(OandaJsonKeys.takeProfit, String. 
valueOf(takeProfit))); 
14 params.add(new BasicNameValuePair(OandaJsonKeys.stopLoss, String. 


valueOf(stopLoss))); 
15 httpPatch.setEntity (new UrlEncodedFormEntity (params) ) ; 
16 return httpPatch; 
17 } 


19 @O0verride 

20 public boolean modifyTrade(Long accountId, Long tradeId, double 
stopLoss, double takeProfit) { 

21 CloseableHttpClient httpClient = getHttpClient(); 


22 try { 

23 HttpPatch httpPatch = createPatchCommand(accountId, tradeld, 
stopLoss, 

24 takeProfit) ; 
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25 LOG. info(TradingUtils.executingRequestMsg(httpPatch) ); 

26 HttpResponse resp = httpClient.execute(httpPatch) ; 

27 if (resp.getStatusLine().getStatusCode() == HttpStatus.SC_OK) { 

28 if (resp.getEntity() != null) { 

29 LOG.info("Trade Modified->" + TradingUtils. 
responseToString(resp) ) ; 

30 } else { 

31 LOG.warn(String. format ( 

32 "trade %d could not be modified with stop loss %3.5f and take 
profit % 3.5 f.httpcode = %d ", 

33 tradeId, stopLoss, takeProfit, resp.getStatusLine(). 
getStatusCode())); 

34 

35 return true; 

36 } else { 

37 LOG.warn(String.format("trade %d could not be modified with stop 
loss %3.5f. http code=%d", 

38 tradeId, stopLoss, resp.getStatusLine().getStatusCode())); 

39 } 

40 } catch (Exception e) { 

41 LOG.error(e); 

42 } finally { 

43 TradingUtils.closeSilently(httpClient) ; 

44} 

45 return false; 

46} 


We begin our discussion by looking at the getTradeForAccountUr1 function that 
computes the REST resource URL that we need to send our patch request to, in order 
to modify the trade. For account ID 123456 and trade ID 234567, the function would 
compute as follows: 


1 https://api-fxtrade.oanda.com/v1/accounts/123456/trades/234567 


Once the URL is computed, we can create an instance of the HttpPatch object to 
prepare our patch command. This time for the list of NameValuePair objects we just have 
to create two of them for take-profit and stop-loss. The list can then be URL-encoded 
and set on the instance of the HttpPatch object. At this point we are ready to fire off the 
modification request to the platform. A successful modification would return an HTTP 
header like this: 


1 HTTP/1.1 200 OK 
2 Content-Type: application/json 
3 Content-Length: 179 


Once we receive an HTTP status code 200, we can return true from the method. 


Otherwise, we return a false in case of another code or error. This is it; that’s all there is 
to the modifyTrade method. 
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The next one on our list is the closeTrade method. It is pretty much identical to the 
closeOrder method and the discussion of the order counterpart applies here. Therefore, 
listing the code should suffice: 


1 @Override 

2 public boolean closeTrade(Long tradeId, Long accountId) { 

3 CloseableHttpClient httpClient = getHttpClient(); 

4 try { 

5 HttpDelete httpDelete = new HttpDelete(getTradeForAccountUrl(tradeld, 

6 accountId)); 

7 httpDelete.setHeader(authHeader) ; 

8 LOG. info(TradingUtils.executingRequestMsg(httpDelete) ) ; 

9 HttpResponse resp = httpClient.execute(httpDelete) ; 

10 if (resp.getStatusLine().getStatusCode() == HttpStatus.SC_OK) { 

11 LOG. info(String.format("Trade %d successfully closed for account %d", 

12 tradeId, accountId)); 

13 return true; 

14 } else { 

15 LOG.warn(String.format("Trade %d could not be closed. Recd error 
code %d", 

16 tradeId, resp.getStatusLine().getStatusCode())); 

17 } 

18 } catch (Exception e) { 

19 LOG.warn("error deleting trade id:" + tradeId, e); 


20 } finally { 
21 TradingUtils.closeSilently(httpClient) ; 


22 } 
23 return false; 
24 4} 


Turning our attention to the R operation for trades, we will observe that there is a 
remarkable resemblance to the Order counterpart. Let’s first look at the method to fetch 
all trades for an account: 


RB 


String getTradesInfoUrl(Long accountId) { 

2 return this.url + OandaConstants.ACCOUNTS RESOURCE + TradingConstants. 

FWD SLASH + accountId + tradesResource; 

} 

4 @Override 

5 public Collection < Trade < Long, String, Long >> 
getTradesForAccount(Long accountId) { 

6 Collection < Trade < Long, String, Long >> allTrades = Lists. 
newArrayList(); 

7 CloseableHttpClient httpClient = getHttpClient(); 

8 try { 

9 HttpUriRequest httpGet = new HttpGet (getTradesInfoUrl(accountId)); 

0 httpGet . setHeader (this. authHeader) ; 

11 httpGet .setHeader(OandaConstants.UNIX_DATETIME_ HEADER); 


w 
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LOG. info(TradingUtils.executingRequestMsg(httpGet) ) ; 
HttpResponse resp = httpClient.execute(httpGet) ; 
String strResp = TradingUtils.responseToString(resp) ; 
if (strResp != StringUtils.EMPTY) { 
Object obj = JSONValue.parse(strResp) ; 
JSONObject jsonResp = (JSONObject) obj; 
JSONArray accountTrades = (JSONArray) jsonResp.get(trades) ; 
for (Object accountTrade: accountTrades) { 
JSONObject trade = (JSONObject) accountTrade; 
Trade < Long, String, Long > tradeInfo = parseTrade(trade, 
accountId); 
allTrades.add(tradeInfo) ; 
} 
} else { 
TradingUtils.printErrorMsg(resp) ; 
} 
} catch (Exception ex) { 
LOG. error (ex); 
} finally { 
TradingUtils.closeSilently(httpClient) ; 
\ 
return allTrades; 


} 


We begin by calling getTradesInfoUr1 to compute the URL that can be fired off to 


the platform to retrieve all the orders for an account. For an account 123456, the method 
would return the value: 


1 


https://api-fxtrade.oanda.com/v1/accounts/123456/trades 


A successful call would result in a JSON payload like the following being returned 


from the platform: 


OW ON DU BRWN BF 
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{ 
"trades": [ 
{ 
"id": 1800805337, 
"units": 3000, 
"side": "sell", 
"instrument": "CHF JPY", 
"time": "1426660416000000", 
"price": 120.521, 
"takeProfit": 105.521, 
"stopLoss": 121.521, 
"trailingStop": 0, 
"trailingAmount": 0 


}, 
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15 { 

16 "id": 1800511850, 

17 "units": 3000, 

18 "side": "buy", 

19 "instrument": "USD CHF", 
20 "time": "1426260592000000", 
21 "price": 1.0098, 

22 "takeProfit": 1.15979, 
23 "stopLoss": 0.9854, 

24 "trailingStop": 0, 

25 "trailingAmount": 0 

26 }, 

27 ] 

28} 


Now what remains is to parse such a payload to create our collection of trades to 
be returned. Since it’s a JSONArray of trades, we need to write a for loop to process each 
element and delegate the attributes parsing to the parseTrade method, as shown here, to 
create and return the Trade POJO. 


1 private Trade < Long, String, Long > parseTrade(JSONObject trade, Long 

accountId) { 

final Long tradeTime = Long.parseLong(trade.get(time).toString()); 

final Long tradeId = (Long) trade.get(id); 

final Long tradeUnits = (Long) trade.get(units); 

final TradingSignal tradeSignal = OandaUtils.toTradingSignal ( (String) 

trade.get(side)); 

6 final TradeableInstrument < String > tradeInstrument = new 
TradeableInstrument < String > ((String) trade 


um BWN 


7 .get (instrument) ); 

8 final double tradeTakeProfit = ((Number) trade.get(takeProfit)). 
doubleValue(); 

9 final double tradeExecutionPrice = ((Number) trade.get(price)). 
doubleValue(); 

10 final double tradeStopLoss = ((Number) trade.get(stopLoss)). 
doubleValue(); 

11 


12 return new Trade < Long, String, Long > (tradeId, tradeUnits, 
tradeSignal, tradeInstrument, new DateTime( 


13 TradingUtils.toMillisFromNanos(tradeTime)), tradeTakeProfit, 
tradeExecutionPrice, tradeStopLoss, 

14 accountId); 

15 

16 =} 


The parsing logic is self-explanatory. The last one to discuss is retrieving a trade with 
a given trade ID and a given account ID. 
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@Override 
public Trade < Long, String, Long > getTradeForAccount(Long tradeld, 
Long accountId) { 
CloseableHttpClient httpClient = getHttpClient(); 
try { 
HttpUriRequest httpGet = new HttpGet (getTradeForAccountUrl(tradeld, 
accountId)); 
httpGet . setHeader (this. authHeader) ; 
httpGet .setHeader(OandaConstants.UNIX_DATETIME HEADER); 
LOG. info(TradingUtils.executingRequestMsg(httpGet) ) ; 
HttpResponse resp = httpClient.execute(httpGet) ; 
String strResp = TradingUtils.responseToString(resp) ; 
if (strResp != StringUtils.EMPTY) { 
JSONObject trade = (JSONObject) JSONValue.parse(strResp) ; 
return parselrade(trade, accountId); 
} else { 
TradingUtils.printErrorMsg(resp) ; 
} 
} catch (Exception ex) { 
LOG. error(ex) ; 
} finally { 
TradingUtils.closeSilently(httpClient) ; 
} 
return null; 


} 


The method begins by calling the getTradeForAccountUr1 function to compute the 


URL for a given account and trade ID that should be fired to retrieve the JSON response. 
If the trade ID is not found, we should technically receive an HTTP 404 response, in 
which case we return a null. If we do get a valid JSON payload back, it should look like the 


following: 

3 

2 "id": 1800805337, 

3 "units": 3000, 

4 "side": "sell", 

5 "instrument": "CHF JPY", 
6 "time": "1426660416000000", 
7 "price": 120.521, 

8 "takeProfit": 105.521, 
9 "stopLoss": 121.521, 

10 "trailingStop": 0, 

11 "trailingAmount": 0 

12. +} 


The rest of the code involves invoking the parseTrade method to parse this JSON 


payload and return the Trade POJO. 
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Encapsulating Read Operations Behind 
TradelnfoService 


This service is arguably a really nice and simple but yet powerful example of why 

we should embrace the concept of services. It demonstrates how a service could, for 
example, introduce an internal cache as an optimization step to avoid going to the data 
provider for the same data again and again, be it a REST service or a database fetch via 
DAO. If we were directly going to the provider for data, even though it does not change 
very often, we would just be introducing unwanted latency and re-computations in the 
request operation even though the results are exactly the same as the last one. By using 
a service, we can introduce an internal cache to manage data provided from the data 
provider (database or an external source like REST) and store computed results that may 
consume CPU cycles or are resource intensive. Let’s start by looking at the definition and 
constructor for this service: 


1 /** 

2 * A service that provides information regarding a Trade. It maintains 

3 * an internal cache of all trades grouped per account in order to 

4 * minimize latency. 

5 * 

6 * <p> 

7 * It is strongly recommended to use this service as a singleton and 

8 * not create multiple instances in order to minimize the memory 

9 * footprint incurred by the cache and the latency induced during the 

10 * cache construction. This class exposes a method to refresh the 

11 * cache if required in a ThreadSafe manner and it is imperative that 

12 * it be called for events which close, create or modify a trade in 

13 * order to keep the cache in sync with the trades on the trading 

14 * platform. If such event callback is not supported by the trading 

15 * platform, then a timer based approach can be implemented externally 
that periodically refreshes the cache. 

16 * </p> 

17 * <p> 

18 * The accountId is the key of the internal cache. If accountId is a 

19 * user defined object, rather than the commonly used ones such as 

20 * Integer, Long, or String, make sure hashCode() and equals() methods 
are implemented. 

21 * </p> 

22 = 

23 * @param <M> 

24 = The type of tradeId 

25 * @param <N> 

26 . The type of instrumentId in class TradeableInstrument 

27 * @param <K> 

28 a The type of accountId 

29 * @see TradeableInstrument 
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30 * @see refreshTradesForAccount 


31 #f 

32 public class TradeInfoService < M, N, K > { 

33 

34 private final TradeManagementProvider < M, 

35 N, 

36 K > tradeManagementProvider ; 

37 private final AccountInfoService < K, 

38 N > accountInfoService; 

39 

40 public TradeInfoService(TradeManagementProvider < M, N, K > 
tradeManagementProvider, 

41 AccountInfoService < K, N > accountInfoService) { 

42 this.tradeManagementProvider = tradeManagementProvider; 

43 this.accountInfoService = accountInfoService; 

44 } 


We have two dependencies that are provided to the constructor, namely the 
TradeManagementProvider and AccountInfoService. We will see soon that as part of the 
initialization process, the first thing the service does is create an internal cache of trades 
per instrument and per account. 


1 //K -> account id type 

2 private final ConcurrentMap < K, Map < TradeableInstrument < N > , 

3 Collection < Trade < M, N, K >>> > tradesCache = Maps 

4 -newConcurrentMap () ; 

5 private final ReadwWriteLock lock = mew ReentrantReadwWriteLock(); 

6 /** 

7 * A method that initializes the service and primarily the cache of 

8 * trades per account for the service. This method is automatically 

9 * invoked by Spring Framework(if used) once the ApplicationContext 

10 * is initialized. If not using Spring, the consumer of this service 

11 * must call this method first in order to construct the cache. 

12 m 

13 * @see TradeManagementProvider 

14 */ 

15 @PostConstruct 

16 public void init() { 

17 reconstructCache(); 

18 } 

19 

20 private void reconstructCache() { 

21 lock.writeLock().lock(); 

22 try { 

23 tradesCache.clear(); 

24 Collection < Account < K >> accounts = this.accountInfoService. 
getAllAccounts(); 
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25 for (Account < K > account: accounts) { 
26 Map < TradeableInstrument < N > , Collection < Trade < M, N, K >>> 
tradeMap = 

27 getTradesPerInstrumentForAccount (account. getAccountId()); 

28 tradesCache. put(account.getAccountId(), tradeMap) ; 

29 ‘ 

30 } finally { 

31 lock.writeLock().unlock(); 

32 } 

a3} 

34 = private Map < TradeableInstrument < N > , Collection < Trade < M, N, K 
>>> 


35 getTradesPerInstrumentForAccount(K accountId) { 
36 Collection < Trade < M, N, K >> trades = 


37 this. tradeManagementProvider.getTradesForAccount (accountId) ; 

38 Map < TradeableInstrument < N > , Collection < Trade < M, N, K >>> 
tradeMap = 

39 Maps ..newHashMap() ; 

40 for (Trade < M, N, K > ti: trades) { 

41 Collection < Trade < M, N, K >> tradeLst = null; 

42 if (tradeMap.containsKey(ti.getInstrument())) { 

43 tradeLst = tradeMap.get(ti.getInstrument()); 

44 } else { 

45 tradeLst = Lists.newArrayList(); 

46 tradeMap.put(ti.getInstrument(), tradeLst); 

47 

48 tradeLst.add(ti); 

49 } 

50 return tradeMap; 

51} 


As you can see, the init() method, which automatically gets invoked by DI 
frameworks like Spring, invokes the internal method reconstructCache(). This method 
begins by first seeking an exclusive write lock that makes sure no other thread is either 
reading or writing from the internal tradesCache. Recall that a ReadWriteLock allows 
access to multiple readers but only to a single writer. Therefore, rightly so, in order to 
preserve the consistency of the cache and what other threads view as the state of the 
cache, we seek the writeLock before updating the cache, putting other threads in the wait 
state should they try to read or write from the cache. 

Once the write lock is granted, we have the permission to start re-populating the 
cache. Since we have to organize all trades per instrument first and then the resulting 
map of instrument-trade list per account ID, we begin by obtaining a list of all accounts 
using accountInfoService. getAllAccounts(). For each of the accounts in the collection 
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of accounts in a loop, we compute the map of collection of trades per instrument by 
invoking the internal method getTradesPerInstrumentForAccount. This method in turn 
uses tradeManagementProvider.getTradesForAccount to get all trades for the given 
account ID. Once we have all the trades, we can loop over them to put them in a map 
keyed by the instrument that they represent the open position for. This is what needs to 
happen to create this internal cache. 

We should now be able to service lots of queries around trades without having to 
go to the underlying provider. We discuss later how and when this cache gets refreshed. 
First let’s start looking at all the services this service offers and how these services use the 
cache to service the request. We begin with a very simple one—isTradeExistsForInstru 
ment, which will be used by other service methods as well. 


1 /** 

2 * 

3 * @param instrument 

4 * @return boolean to indicate whether a trade with given instrument 

5 exists. */ 

6 public boolean isTradeExistsForInstrument(TradeableInstrument < N > 
instrument) { 

7 lock. readLock().lock(); 

8 try { 

9 for (K accountId: this.tradesCache.keySet()) { 

10 if (isTradeExistsForInstrument(instrument, accountId)) { 

11 return true; 

12 } 

13 } 


14 } finally { 
15 lock.readLock().unlock(); 


16 } 
17 return false; 
18 «(} 


19 private boolean isTradeExistsForInstrument(TradeableInstrument < N > 
instrument, K accountId) { 

20 Map < TradeableInstrument < N > , Collection < Trade < M, N, K >>> 
tradesForAccount = 

21 this. tradesCache. get (accountIqd) ; 

22 synchronized(tradesForAccount) { 

23 if (TradingUtils.isEmpty(tradesForAccount)) { 

24 return false; 

25 } 

26 return tradesForAccount.containsKey(instrument) ; 

27 } 

28 

29} 
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The method begins by seeking a ReadLock to read data from the cache. This 
involves looping over all available account ID keys of the cache and trying to ascertain 
if an instrument key exists in the underlying map. This is encapsulated in the private 
overloaded method with the same name. You might ask why are we synchronizing on the 
underlying map, which is the value in the cache that’s keyed by account ID? The answer 
lies in the method refreshTradesForAccount: 


/** 

A convenient method to refresh the internal cache of trades for an 
account in a ThreadSafe manner. Ideally this method should be 
invoked when the Trading platform notifies of a Trading event such 
as a creation of Trade when an Order is filled or the Trade is 
settled 

* when a stopLoss or a takeProfit level is hit. 

* 


UmPPWN PR 
* * * * 


6 
7 
8 * @param accountId 
9 */ 

0 


1 public void refreshTradesForAccount(K accountId) { 

11 Map < TradeableInstrument < N > , Collection < Trade < M, N, K >>> 
tradeMap = 

12 getTradesPerInstrumentForAccount (accountId) ; 


13 Map < TradeableInstrument < N > , Collection < Trade < M, N, K >>> 
oldTradeMap = tradesCache.get(accountId) ; 

14 synchronized(oldTradeMap) { 

15 oldTradeMap.clear(); 

16 oldTradeMap.putAl1(tradeMap) ; 

17 } 


19 } 


In summary, this method gives external clients of this service the ability to refresh 
the cache based on an event that they deem might require the cache to be refreshed for a 
given account ID. As we will discuss in later chapters, we can register handlers for various 
platform events like OrderFilled, for which we receive a callback when, for example, a 
pending order is filled. This event results in the creation of a new trade on the platform, 
which means our cache needs updating and brought in sync with the platform. When 
the underlying value map for the given account ID needs to be refreshed, we must make 
sure that the refresh code is synchronized on the underlying value map. This is why we 
see these synchronized blocks of code in the methods, which guarantees that if the map 
is being refreshed as a result of event, another reader waits and, vice versa, the refresh 
process waits until the read is finished. 

The next service method we discuss is getTradesForAccountAndInstrument, which 
as the name says, retrieves a list of trades for a given account ID and instrument. 


/** 
* @param accountId 
* @param instrument 
* @return a Collection of Trades for a given instrument and for a given 
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* account.An empty Collection is returned if none found. 
=f 
public Collection < Trade < M, N, K >> getTradesForAccountAndInstrume 
nt(K accountId, 
TradeableInstrument < N > instrument) { 
Map < TradeableInstrument < N > , Collection < Trade < M, N, K >>> 
tradesForAccount = 
this .tradesCache. get (accountId) ; 
synchronized(tradesForAccount) { 
if (!TradingUtils.isEmpty(tradesForAccount) && 
tradesForAccount.containsKey(instrument)) { 
return Lists.newArrayList (tradesForAccount.get (instrument) ) ; 
} 
} 


return Collections.emptyList(); 


i 


This service method code is fairly straightforward. The only thing worth mentioning 


again is the use of synchronized block to access the value map for the given account 
ID. The rest of the code is self-explanatory. The next one and again a very simple one is 
getTradesForAccount. This method returns all trades for a given account ID. 


1 
2 
3 
A 
5 
6 
7 


co 


/** 

* 

* @param accountId 

* @return a Collection of all Trades for a given accountId. An empty 
* Collection is returned if none found. 

*/ 
public Collection < Trade < M, N, K >> getTradesForAccount(K accountId) 
{ 

Map < TradeableInstrument < N > , Collection < Trade < M, N, K >>> 
tradesForAccount = 

this. tradesCache. get (accountIqd) ; 

Collection < Trade < M, N, K >> trades = Lists.newArrayList(); 
synchronized(tradesForAccount) { 

if (TradingUtils.isEmpty(tradesForAccount)) { 

return trades; 

} 

for (Collection < Trade < M, N, K >> tradeLst: tradesForAccount. 

values()) { 

trades.addAll(tradeLst) ; 
} 
r 


return trades; 


} 
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The same principle applies as usual to this code. We get the map of trades keyed by 
instrument for a given account ID. We loop for all entries in the map in a synchronized 
block and add the values of the map entry in a collection and return it. 

The next method we discuss, getAl1 Trades, returns a collection of all trades for each 
account. The code involves looping through all account IDs, i.e., the keys of our cache, 
and for each key, it calls the method getTradesForAccount and adds the collection 
of trades to an existing collection, which contains all trades fetched for previous keys 
(account IDs). 


4 /** 

2 * @return a Collection of all trades that belong to all accounts for the 
3 user */ 

4 public Collection < Trade < M, N, K >> getAllTrades() { 

5 lock.readLock().lock(); 

6 try { 

7 Collection < Trade < M, N, K >> trades = Lists.newArrayList(); 
8 for (K accId: this.tradesCache.keySet()) { 

9 trades. addAll(getTradesForAccount(accId)); 

10 } 

11 return trades; 


12 } finally { 

13 lock. readLock().unlock(); 
14 } 

15 } 


We can use this internal cache and derive some other useful information such as: 
e What is the net count of positions for a given currency? 
e Find all accounts that have trades for a given instrument. 


e What is the value of total open positions? 


We are going to code the first two questions to demonstrate how quickly 
we can get answers to various questions using this cache. The first one is called 
findNetPositionCountForCurrency, and it returns the net count of open positions for 
the given currency. 


1 /** 

2 * 

3 * @param currency 

4 * @return the net position for a given currency considering all Trades 

5 * for all Accounts. A negative value suggests that the system has net 

6 - short position for the given currency, while a positive 
value 

7 * suggests a net long position. 

8 * @see TradingUtils#getSign(String, 

9 - com.precioustech. fxtrading.TradingSignal, String) 

10 mf: 
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11 public int findNetPositionCountForCurrency(String currency) { 
12 int posCt = 0; 
13 lock. readLock().lock(); 


14 try { 

15 for (K accountId: this.tradesCache.keySet()) { 

16 posCt += findNetPositionCountForCurrency(currency, accountId); 
17 } 


18 } finally { 
19 lock.readLock().unlock(); 


20 } 

21 return posCt; 
22. ~+} 

23 


24 ‘private int findNetPositionCountForCurrency(String currency, K 
accountId) { 

25 Map < TradeableInstrument < N > , Collection < Trade < M, N, K >>> 
tradeMap = this.tradesCache.get(accountId) ; 

26 synchronized(tradeMap) { 

27 if (TradingUtils.isEmpty(tradeMap)) { 


28 return 0; 

29 } else { 

30 int positionCtr = 0; 

31 for (Collection < Trade < M, N, K >> trades: tradeMap.values()) { 

32 for (Trade < M, N, K > tradeInfo: trades) { 

33 positionCtr += TradingUtils.getSign(tradeInfo.getInstrument(). 
getInstrument(), 

34 tradeInfo.getSide(), currency); 

35 } 

36 i 

37 return positionCtr; 

38 } 

39} 

40 } 


From this code, you can see that most of the work is done in the internal overloaded 
method with the same name. The public API method just loops through the account ID 
keys in the cache and delegates to the private method. The private method, as we will 
soon see, returns a net count of positions for the given currency and account. This result 
is added to a running count of positions, which, after the loop terminates, is returned 
from the method as the final answer. 

Now, returning to the internal private method findNetPositionCountForCurrency, 
the code is extremely straightforward. For each instance of the account ID key, we get 
the map of trades keyed by the instrument. For each of the trades in the list of trades for 
the given instrument, we just delegate to our versatile function TradingUtils.getSign, 
which does all the computation. Notice that we just pass the instrument pair for the 
trade and the currency in question directly to the function, without even checking if the 
currency in question is part of the pair. This is taken care of by the function, as it returns 0 
for such cases. 
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Now we come to the last service method left to discuss, called 
findAllAccountsWithInstrumentTrades, which, as the name suggests, returns a list of 
all account IDs that have an open position for the given instrument. The following code, 
which is extremely straightforward, does not require much explanation. The method 
delegates to isTradeExistsForInstrument, which ascertains if we should add the current 
account ID in the loop to the collection to be returned. 


/** 

* @param instrument 

* @return a Collection of accountIds that have at least 1 trade for the 
* given instrument. An empty Collection is returned if none 

* satisfy this condition. 

*/ 

public Collection < K > findAllAccountsWithInstrumentTrades(TradeableIn 
strument < N > instrument) { 

8 Collection < K > accountIds = Sets.newHashSet(); 

9 lock.readLock().lock(); 
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10 ~=s try { 

11 for (K accountId: this.tradesCache.keySet()) { 

12 if (isTradeExistsForInstrument(instrument, accountId)) { 
13 accountIds.add(accountId) ; 

14 } 

15 } 


16 } finally { 
17 lock. readLock().unlock(); 


18 } 
19 return accountIds; 
20 ~+} 


Try It Yourself 


In this section we write demo programs for all trade and order services that we have 
discussed in this chapter. First we write a demo program to place a limit order using 
OrderExecutionService: 


1 package com.precioustech.fxtrading. order; 

2 

3 import java.util.concurrent.BlockingQueue; 

4 import java.util.concurrent.LinkedBlockingQueue; 

5 

6 import org.apache.log4j.Logger; 

7 

8 import com.precioustech.fxtrading.BaseTradingConfig ; 
9 import com.precioustech. fxtrading.TradingDecision; 
10 import com.precioustech. fxtrading.TradingSignal ; 

11 import com.precioustech. fxtrading.account.AccountDataProvider ; 
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import com.precioustech. fxtrading.account.AccountInfoService ; 
import com.precioustech. fxtrading.account.AccountInfoServiceDemo; 
import com.precioustech. fxtrading.helper.ProviderHelper ; 

import com.precioustech. fxtrading. instrument. TradeableInstrument ; 
import com.precioustech. fxtrading.marketdata.CurrentPriceInfoProvider ; 
import com.precioustech. fxtrading.marketdata.historic. 
HistoricMarketDataProvider ; 

import com.precioustech. fxtrading.marketdata.historic. 
MovingAverageCalculationService ; 

import com.precioustech.fxtrading.oanda.restapi.account. 
OandaAccountDataProviderService; 

import com.precioustech.fxtrading.oanda.restapi.helper. 
OandaProviderHelper ; 

import com.precioustech. fxtrading.oanda.restapi.marketdata. 
OandaCurrentPriceInfoProvider ; 

import com.precioustech. fxtrading.oanda.restapi.marketdata.historic. 
OandaHistoricMarketDataProvider ; 

import com.precioustech. fxtrading.oanda.restapi.order. 
OandaOrderManagementProvider ; 

import com.precioustech. fxtrading.oanda.restapi.trade. 
OandaTradeManagementProvider ; 

import com.precioustech. fxtrading.trade.TradeInfoService; 

import com.precioustech. fxtrading. trade. TradeManagementProvider ; 


public class OrderExecutionServiceDemo { 


private static final Logger LOG = Logger.getLogger(AccountInfoService 
Demo.class); 


private static void usage(String[] args) { 
if (args.length != 3) { 
LOG.error("Usage: OrderExecutionServiceDemo <url> <username> 
<accesstoken>"); 
System.exit(1); 
} 
} 


public static void main(String[] args) throws Exception { 
usage(args) ; 

String url = args[0]; 

String userName = args[1]; 


String accessToken = args[2]; 


BlockingQueue < TradingDecision < String >> orderQueue = 
new LinkedBlockingQueue < TradingDecision < String >> (); 
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49 AccountDataProvider < Long > accountDataProvider = 

50 new OandaAccountDataProviderService(url, userName, accessToken); 
51 CurrentPriceInfoProvider < String > currentPriceInfoProvider = 
52 new OandaCurrentPriceInfoProvider(url, accessToken) ; 


53 BaseTradingConfig tradingConfig = new BaseTradingConfig(); 
54 tradingConfig.setMinReserveRatio(0.05); 


55 tradingConfig.setMinAmountRequired(100.00) ; 
56 tradingConfig.setMaxAllowedQuantity(10) ; 
57 ProviderHelper < String > providerHelper = new 
OandaProviderHelper(); 
58 AccountInfoService < Long, String > accountInfoService = 
59 new AccountInfoService < Long, String > (accountDataProvider, 
60 currentPriceInfoProvider, tradingConfig, providerHelper) ; 
61 
62 OrderManagementProvider < Long, String, Long > 
orderManagementProvider = 
63 new OandaOrderManagementProvider(url, accessToken, 
accountDataProvider) ; 
64 
65 TradeManagementProvider < Long, String, Long > 
tradeManagementProvider = 
66 new OandaTradeManagementProvider(url, accessToken) ; 
67 
68 OrderInfoService < Long, String, Long > orderInfoService = 
69 new OrderInfoService < Long, String, Long > 
(orderManagementProvider) ; 
70 
71 TradeInfoService < Long, String, Long > tradeInfoService = 
72 new TradeInfoService < Long, String, Long > 
(tradeManagementProvider, 
73 accountInfoService) ; 
74 
75 HistoricMarketDataProvider < String > historicMarketDataProvider = 
76 new OandaHistoricMarketDataProvider(url, accessToken) ; 
77 
78 MovingAverageCalculationService < String > 
movingAverageCalculationService = 
79 new MovingAverageCalculationService < String > 
(historicMarketDataProvider) ; 
80 
81 PreOrderValidationService < Long, String, Long > 
preOrderValidationService = 
82 new PreOrderValidationService < Long, String, Long > ( 
83 tradeInfoService, movingAverageCalculationService, tradingConfig, 
orderInfoService) ; 
84 
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85 OrderExecutionService < Long, String, Long > orderExecService = 

86 new OrderExecutionService < Long, String, Long > ( 

87 orderQueue, accountInfoService, orderManagementProvider, 

88 tradingConfig, preOrderValidationService, 

89 currentPriceInfoProvider) ; 

90 orderExecService.init(); 

91 

92 TradingDecision < String > decision = 

93 new TradingDecision < String > (mew TradeableInstrument < String > 
("GBP_USD"), 

94 TradingSignal.LONG, 1.44, 1.35, 1.4); 

95 orderQueue.offer(decision) ; 

96 Thread.sleep(10000); // enough time to place an order 

97 orderExecService. shutDown() ; 

98 

99 } 

100 } 


Name: OrderExecutionServiceDemo 
© main (P= Arguments Bi JRE “> Classpath | By Source BB Environment |) Common 
Program arguments: 


https://api-fxtrade.canda.com ereremecy 


Variables 
VM arguments: 
Variables 
Use the -XstartOnFirstThread argument when launching with SWT 
Working directory 
© Defautt: 
Other: 
Close Run | 


Figure 6-1. Launch configuration 
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Figure 6-3. Oanda order ticket 


Next we write a demo for OrderInfoService: 
package com.precioustech. fxtrading.order ; 
import java.util.Collection; 


import org.apache.log4j.Logger; 
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import com.precioustech. fxtrading.account.AccountDataProvider ; 
import com.precioustech. fxtrading. instrument. TradeableInstrument ; 
import com.precioustech.fxtrading.oanda.restapi.account. 
OandaAccountDataProviderService ; 

import com.precioustech.fxtrading.oanda.restapi.order. 
OandaOrderManagementProvider ; 


public class OrderInfoServiceDemo { 


private static final Logger LOG = Logger. 
getLogger (OrderInfoServiceDemo.class); 


private static void usage(String[] args) { 

if (args.length != 3) { 
LOG.error("Usage: OrderExecutionServiceDemo <url> <username> 
<accesstoken>"); 

System.exit(1); 


} 
public static void main(String[] args) { 


usage(args); 

String url = args[0]; 

String userName = args[1]; 
String accessToken = args[2]; 


AccountDataProvider < Long > accountDataProvider = 
new OandaAccountDataProviderService(url, userName, accessToken); 


OrderManagementProvider < Long, String, Long > orderManagementProvider = 
new OandaOrderManagementProvider(url, accessToken, 
accountDataProvider) ; 


OrderInfoService < Long, String, Long > orderInfoService = 
new OrderInfoService < Long, String, Long > 
(orderManagementProvider) ; 


TradeableInstrument < String > gbpusd = new TradeableInstrument < 
String > ("GBP_USD"); 


orderInfoService.allPendingOrders() ; 


Collection < Order < String, Long >> pendingOrdersGbpUsd = 
orderInfoService.pendingOrdersForInstrument (gbpusd) ; 
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LOG. info( 
String. format ("+++++++++++++++4++++ Dumping all pending orders for %s 
+++", 
gbpusd.getInstrument())); 
for (Order < String, Long > order: pendingOrdersGbpUsd) { 
LOG. info( 
String. format("units=“d, takeprofit=%2.5f,stoploss=%2.5f, limitpri 
ce=%2.5f,side=%s", 
order.getUnits(), order.getTakeProfit(), order.getStopLoss(), 
order.getPrice(), order.getSide())); 


} 

int usdPosCt = orderInfoService. findNetPositionCountForCurrency 
("USD"); 

int gbpPosCt = orderInfoService. findNetPositionCountForCurrency 
("GBP"); 


LOG.info("Net Position count for USD = " + usdPosCt); 
LOG.info("Net Position count for GBP = " + gbpPosCt); 
Collection < Order < String, Long >> pendingOrders = 
orderInfoService.allPendingOrders() ; 
LOG. info("++++++++4+++++4+++4+++ Dumping all pending orders ++++++++"); 
for (Order < String, Long > order: pendingOrders) { 
LOG. info( 
String. format ("instrument=%s ,units=4d, takeprofit=%2.5f,stoploss=%2 
-5f, limitprice=%2.5f,side=%s", 
order.getInstrument().getInstrument(), order.getUnits(), order. 
getTakeProfit(), 
order.getStopLoss(), order.getPrice(), order.getSide())); 
} 
} 
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Name: OrderinfoServiceDemo 


(© main ee Aeguments b= RE) %; Ctasspatn Ey Source | BR Environment |] Common 3] 


Program arguments: 


https://api-fxtrade.canda.com GvassmmDy 
| Ste th ene teen te tent cle nce re A ty sc ne inne ae rennet 


Veriables..._ 


VM arguments: 


© Use the -XstartOnFirstThread argument when launching with SWT 


Working directory: 
© Default: 


las 


(> Other: 


Figure 6-4. Launch configuration 


@ Javadoc |) Probiems [Q, Deciaration $7 Search yj Progress © Console £8 [HJ task List 2) Tasks ig Coverage yoy Git Staging History NX % REG 
{terminated> OrderintaServiceDemo {Jarra Application] {Library Javal JavaVetualMachines/id'-7.0_71 jok/Contents{Momejtin\java (27 Jan 2016 17:05:11) 

SAPO UU = CARRUTy PeQUESE FO UEE NCEP E77 Op 1 - TRE ORE CUNOU , COmY VAs UL CUUIIES/ (99 /09/ OF USNS TLS CR UNUNC= Ger Ubu WINKs Ak 
INFO [main] - terersereerereerers Dumping all ponding orders for CBP_USD ++ 

INFO [main] ~ units~I®, tokeprofit=1.44800, stoploss~1. 35008, Limi tprice=1.48020,side-LONG 

INFO [main] ~ Executing request : GET https://api-fxtrade.canda.com/vi/accounts?usernase~qummahemy HTTP/1.1 

INFO [main] - Executing request : GET https://api-fxtrade.canda.com/vi/accounts/ POMS HTTP/1.1 

INFO [main] - Executing request : GET https://api-fxtrade.canda.com/vi/accounts/#Oeeee HTTP/1.1 

INFO [main] - Executing request : GET https://api-fxtrade.canda.com/v1/accounts/Se@eRePHTTP/1.1 

INFO [main] - Executing request : GET https://opi-fxtrade.canda.com/v1/accounts/tadieHTTP/1.1 

INFO [main] - Executing request : GET https://epi-fxtrode.condo.com/vi/eccounts/ Mame HTTP/1.1. 

INFO [moin] - Executing request ; GET https://api-fxtrade.conda.com/vi/accounts/ AMOR HTTP/ 1.1 

INFO [moin] ~ Executing request : GET https://ooi-fxtrade.canda.com/vi/accounts/ AmsMi@/orders HITP/1.1 


2016-01-27 
2016-01-27 


INFO [main] - Executing request : GET https://api-fxtrade.canda.com/vi/account s@@eMBWorders HTTP/1.1 
INFO [main] - Executing request : GET https://opi-fxtrade.canda.com/vi/accounts/@addabdorders HITP/1.1 
INFO [main] - Executing request : GET https://api-fxtrade.canda.com/vi/accounts/ARemorders HITP/1.1 


17:05:23,372 INFO [main] - Executing request 
17:05:23,813 INFO [main] - Executing request 
27:05:24,268 INFO [moin] - Executing request 
17:05:24,687 INFO [main] - Executing request 
27:05:24,811 INFO [main] - Executing request 
INFO [main] - Executing request 
INFO [main] - Executing request 
INFO [main] - Executing request 


GET https://apt -Fxtrade.canda.com/vi/accounts/S9s9eWorders HTTP/1.1 
GET https: //api-Fxtrede.canda.com/vi/accounts/Ream@étworders HTTP/! 
GET https://opi-fxtrade.conda. com/vi/accounts use rnte= Sa, 
GET hetps://opi -Fxtrade.canda.com/vi/accounts/MSeMPHTTP/1.1 
GET hetps://oni-Fxtrade.canda.com/vi/accounts/*ORPNSHTTP/1.1 
GET https://api -fxtrade.canda.com/vi/accounts/SSORFHTTP/1.1 
GET https://opi-fxtrade.canda.com/vi/accounts/MeG@@@ HTTP/1.1 
GET https://opt-fxtrade. conde. com/v1/eccounts/S0@AfdegHTTP/1.1 


INFO [main] - Executing request : GET https://api-fxtrade.canda.com/vi/accounts/ sitdaiiaiteHTTP/2. 1. 

INFO [main] - Executing request ; GET https://api-fxtrade.canda.com/vi/accounts/Mathlaiyorders HTTP/1.1 
INFO [main] - Executing request ; GET https://opi-fxtrade.canda.com/vi/accounts/@6@a@isorders HTTP/1.1 
INFO [main] - Executing request : GET https://opi-fxtrade.canda.com/vi/accounts/Seeewerorders HTTP/1.1 
INFO [main] - Executing request : GET https://api-fxtrade.canda.com/vi/accounts/ eae orders HITP/1.1 
INFO [main] - Executing request : GET https://api-fxtrade.canda.com/vi/accounts/#999eeMorders HTTP/1.1 
INFO [main] - Executing request : GET https://opi-fxtrade.conda.com/vi/occounts/MEE@Morders HTTP/1.1 
INFO [moin] - Net Position count for USO = -1 

INFO [main] - Net Position count for GBP = 1 


17:05:28,885 INFO [main] 
17:05:28,511 INFO [main] 
17:05:28,621 INFO [main] 
17:05:28,735 INFO [main] 
17:05:28,843 INFO [main] - Executing request 
17:05:28,949 INFO [moin] - Executing request 
INFO [main] - Executing request 
INFO [main] - Executing request 
INFO [main] - Executing request 
INFO [main] - Executing request 
INFO [main] - Executing request 


Executing request 
Executing request 
Executing request 
Executing request 


GET hitps://api -fxtrade.canda.com/v1/accounts ?usernate~q@ageediaidies HTTP/ 1.1 
GET https: //opi-fxtrade.canda.com/vi/accounts/@eeeeaetTTP/ 1.1 

GET hetps://api-fxtrade.canda.com/vi/accounts/eseeees HTTP/1.1 

GET hetps://api-fxtrade.canda.com/v1/accounts/FRePRMUTTP/1.1 

GET https: //api-fxtrade.canda.com/v1/accounts/ OSMITTP/1.1 

GET https: //opi-Fxtrade. conde. com/vi/accounts Ase@OGGeHTTP/1.1 

GET https://opi-Ffrtrade, conde. com/v1/accounts/MPSRSHTTP/ 1,1 

GET https: //api - fxtrade.conda.com/vi/accounts/iéathiate orders HTTP/1.1 

GET hetps://api-fxtrade.canda.com/vi/accounts/ tédebdidmborders HTTP/1.2 

GET https: //api-fxtrade.canda.com/vi/accounts/S@6@e@sorders HTTP/1.1 

GET https://opi-Fxtrade.canda.com/vi/accounts/M@MPF/orders HITP/1.1 
17:05:31,841 INFO [main] - Executing request : GET https://opi-fxtrade.canda.com/vi/accounts/ aia orders HTTP/1.1 
17:05:31,466 INFO [main] - Executing request : GET https: //opi-fxtrade.canda.com/vi/accounts/Paemorders HTTP/1.1 
17:05:31,887 INFO [main] - sessesererecesesese Dumping all pending orders seseeees 

17:05:32,888 INFO [main] - instrument-GEP_USD,units-10, takeprofit-1.44000, stoploss=1. 35000, limi tprice-1.40000, side=LONG 


Figure 6-5. Sample output 
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Now a demo program for PreValidationService: 


package com.precioustech. fxtrading.order ; 
import org.apache.log4j.Logger; 


import com.precioustech. fxtrading.BaseTradingConfig; 

import com.precioustech. fxtrading. TradingSignal ; 

import com.precioustech. fxtrading.account.AccountDataProvider ; 
import com.precioustech. fxtrading.account.AccountInfoService; 
import com.precioustech. fxtrading.helper.ProviderHelper ; 

import com.precioustech. fxtrading. instrument. TradeableInstrument ; 
import com.precioustech. fxtrading.marketdata.CurrentPriceInfoProvider ; 
import com.precioustech. fxtrading.marketdata.historic. 
HistoricMarketDataProvider ; 

import com.precioustech. fxtrading.marketdata.historic. 
MovingAverageCalculationService ; 

import com.precioustech. fxtrading.oanda.restapi.account. 
OandaAccountDataProviderService; 

import com.precioustech. fxtrading.oanda.restapi.helper. 
OandaProviderHelper ; 

import com.precioustech. fxtrading.oanda.restapi.marketdata. 
OandaCurrentPriceInfoProvider ; 

import com.precioustech. fxtrading.oanda.restapi.marketdata.historic. 
OandaHistoricMarketDataProvider ; 

import com.precioustech. fxtrading.oanda.restapi.order. 
OandaOrderManagementProvider ; 

import com.precioustech. fxtrading.oanda.restapi.trade. 
OandaTradeManagementProvider ; 

import com.precioustech. fxtrading. trade. TradeInfoService ; 

import com.precioustech. fxtrading. trade. TradeManagementProvider ; 


public class PreValidationServiceDemo { 


private static final Logger LOG = Logger.getLogger(PreValidationServ 
iceDemo.class); 


private static void usage(String[] args) { 
if (args.length != 3) { 
LOG.error("Usage: PreValidationServiceDemo <url> <username> 
<accesstoken>"); 
System.exit(1); 
} 
} 
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public static void main(String[] args) { 
usage(args) ; 
String url = args[0]; 
String userName = args[1]; 
String accessToken = args[2]; 


AccountDataProvider < Long > accountDataProvider = 
new OandaAccountDataProviderService(url, userName, accessToken); 


OrderManagementProvider < Long, String, Long > 
orderManagementProvider = 

new OandaOrderManagementProvider(url, accessToken, 
accountDataProvider) ; 


TradeManagementProvider < Long, String, Long > 
tradeManagementProvider = 

new OandaTradeManagementProvider(url, accessToken) ; 
CurrentPriceInfoProvider < String > currentPriceInfoProvider = 
new OandaCurrentPriceInfoProvider(url, accessToken) ; 
BaseTradingConfig tradingConfig = new BaseTradingConfig(); 
tradingConfig.setMinReserveRatio(0.05); 
tradingConfig.setMinAmountRequired(100.00) ; 
tradingConfig.setMaxAllowedQuantity (10) ; 
tradingConfig.setMaxAllowedNetContracts(3); 

ProviderHelper < String > providerHelper = new 
OandaProviderHelper(); 


AccountInfoService < Long, String > accountInfoService = 
new AccountInfoService < Long, String > (accountDataProvider, 
currentPriceInfoProvider, tradingConfig, providerHelper) ; 


TradeInfoService < Long, String, Long > tradeInfoService = 
new TradeInfoService < Long, String, Long > ( 
tradeManagementProvider, accountInfoService) ; 


tradeInfoService.init(); 


HistoricMarketDataProvider < String > historicMarketDataProvider 
new OandaHistoricMarketDataProvider(url, accessToken) ; 


MovingAverageCalculationService < String > 
movingAverageCalculationService = 

new MovingAverageCalculationService < String > 
(historicMarketDataProvider) ; 
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OrderInfoService < Long, String, Long > orderInfoService = 
new OrderInfoService < Long, String, Long > 
(orderManagementProvider) ; 


PreOrderValidationService < Long, String, Long > 
preOrderValidationService = 

new PreOrderValidationService < Long, String, Long > 

(tradeInfoService, 

movingAverageCalculationService, tradingConfig, orderInfoService) ; 
TradeableInstrument < String > eurusd = new TradeableInstrument < 
String > ("EUR _USD"); 
TradeableInstrument < String > usdjpy 
String > ("USD JPY"); 
boolean isEurUsdTraded = preOrderValidationService.checkInstrumentNo 
tAlreadyTraded(eurusd) ; 
boolean isUsdJpyTraded = preOrderValidationService.checkInstrumentNo 
tAlreadyTraded(usdjpy) ; 
LOG.info(eurusd.getInstrument() + " trade present? " + 
!isEurUsdTraded) ; 
LOG. info(usdjpy.getInstrument() + " trade present? " + 
!isUsdJpyTraded) ; 


new TradeableInstrument < 


TradeableInstrument < String > usdzar = new TradeableInstrument < 
String > ("USD ZAR"); 


boolean isUsdZarTradeInSafeZone = preOrderValidationService. 
isInSafeZone(TradingSignal.LONG, 17.9, usdzar); 

LOG. info(usdzar.getInstrument() + " in safe zone? " + 
isUsdZarTradeInSafeZone) ; 

boolean isEurUsdTradeInSafeZone = preOrderValidationService. 
isInSafeZone(TradingSignal.LONG, 1.2, eurusd); 

LOG. info(eurusd.getInstrument() + " in safe zone? " + 
isEurUsdTradeInSafeZone) ; 


TradeableInstrument < String > nzdchf = new TradeableInstrument < 
String > ("NZD CHF"); 


preOrderValidationService.checkLimitsForCcy(nzdchf, TradingSignal. 
LONG) ; 
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Name: PreValidationServiceDemo 


Re | & Classpath | ky souree| BB Environment | [2] Common 


Program arguments: 


hitps://api-fxtrade.canda.com Gravee 
re ER Re ice RT 


VM arguments: 


© Use the -XstartOnFirstThread argument when launching with SWT 


Working directory: 
© Default: 


Other: 


Variables... 


Variables... _ 


Figure 6-6. Launch configuration 


mewee sais tenons ower cee ire ees 
EUR_USD trede present? tree 
USO_2PY trede present? false 


~ Executing request : GET mttps://apt -fxtrade.canda.co/vi/candles instrument -USO_ZAREcand| cf ormat-mi dpointkgranuleri ty-Mbdai lyAligneent-@hal i grment Timezone-Europek2FLondor 


VSO_ZAR in sofe zone? folse 
Executing request + GET ht 
EUR_USO in sofe zone? true 
Executing request = GET https: //opi-fxtrade canda.cow/vi/occounts?userneme-ammaniasy HTTP/1.2 
Executing request : GET https: //api-fxtrade.canda.cow/vi/occounts/ POPRF HTTP/1. 2 

Executing request © GET https: //op\-fxtrade conde. con/vi/occounts/4S00Gm HTTP/1.1 

Executing request + GET https: //ap\-fxtrade.cande..con/vi/occount s/@QSee@ee(TTP/1. 1 

xecuting request © GET https: //opi-fxtrade,cande.con/vi/occount s/ PROF HTTP/ Et 

Executing request + GET httos://ap)-fxtrade cande.con/vi/account s/ 799980 NTTP/t.t 

Executing request © GET Nttos://ep\ -fxtrade. conde. con/vi/occount s/POORRPMITTP/ S$ 

Executing request GET httos://opi-fxtrade.cande.con/vi/account s/POeSForders HITP/t.2 
Cxecuting request © GET https: //api -fxtrade.conde.con/vi/occount s/eseSW orders NTTP/1.2 
Caecuting request © GLT httos://epi -fxtrode.conde.con/vi/occounts/SOO0W orders HTTP/3.2 

~ Caecuting request » CLT httos://api -fxtrede.conde.con/vi/occounts/PIRRMMorders MTTP/2.2 
Cuecuting request « GET Attos: //ap) -fxtrode conde. con/vi/occount s/S7PFEMorders HTTP/3.2 
Executing request : GET https: //eps -fatrade cande,con/vi/accounts/APeMorders HITP/3.3 


Rejecting LONG Tredeableinstrument [instrument-US0_ZAR, cescription-null, instrumentié-mull, pip-@.@, instrumentPoirInterestRate-null] becouse price 17.98008 is 1@pct or 


Hops -Futrode. conde. con/vi/cond Les Pinstrument-CUR_USDLCens! oF ormat-ai dpointhgronaleri ty-Mbdat lyAl igneent-@hol i grmont Timezone-EuropeX2FLondor 


~ Connot plece trade Tradeablelnstrument [instrument-NZD_CHF, description-mull, instrumentid-null, pip-O.@, instrumentPeirinterestRate-rwll) because max Limit exceeded. wax 


Figure 6-7. Sample output 
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The last demo program is based on using TradeInfoService: 


package com.precioustech. fxtrading. trade; 


import 
import 


import 
import 
import 
import 
import 
import 
import 


java.util.Collection; 
org.apache. log4j. Logger; 


com.precioustech. fxtrading.BaseTradingConfig ; 
com.precioustech. fxtrading. account .AccountDataProvider ; 
com.precioustech. fxtrading.account.AccountInfoService; 
com.precioustech. fxtrading.helper.ProviderHelper ; 
com.precioustech. fxtrading. instrument. TradeableInstrument ; 
com.precioustech. fxtrading.marketdata.CurrentPriceInfoProvider ; 
com.precioustech. fxtrading.oanda.restapi.account. 


OandaAccountDataProviderService; 


import 


com.precioustech. fxtrading.oanda.restapi.helper. 


OandaProviderHelper ; 


import 


com.precioustech. fxtrading.oanda.restapi.marketdata. 


OandaCurrentPriceInfoProvider ; 


import 


com.precioustech. fxtrading.oanda.restapi.trade. 


OandaTradeManagementProvider ; 


public 


class TradeInfoServiceDemo { 


private static final Logger LOG = Logger. 
getLogger (TradeInfoServiceDemo.class) ; 


private static void usage(String[] args) { 
if (args.length != 3) { 


LOG. 


error("Usage: TradeInfoServiceDemo <url> <username> 


<accesstoken>") ; 
System.exit(1); 


} 
} 


public static void main(String[] args) { 
usage(args) ; 

String url = args[0]; 

String userName = args[1]; 

String accessToken = args[2]; 

AccountDataProvider < Long > accountDataProvider = 


OandaAccountDataProviderService(url, userName, accessToken) ; 


CurrentPriceInfoProvider < String > currentPriceInfoProvider = 


OandaCurrentPriceInfoProvider(url, accessToken) ; 


BaseTradingConfig tradingConfig = new BaseTradingConfig(); 
tradingConfig.setMinReserveRatio(0.05); 
tradingConfig.setMinAmountRequired(100.00) ; 
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tradingConfig.setMaxAllowedQuantity(10) ; 

ProviderHelper < String > providerHelper = new OandaProviderHelper(); 
AccountInfoService < Long, String > accountInfoService = 

new AccountInfoService < Long, String > (accountDataProvider, 

currentPriceInfoProvider, tradingConfig, providerHelper) ; 

TradeManagementProvider < Long, String, Long > 
tradeManagementProvider = 

new OandaTradeManagementProvider (url, 

accessToken); 


TradeInfoService < Long, String, Long > tradeInfoService = 
new TradeInfoService < Long, String, Long > ( 
tradeManagementProvider, accountInfoService) ; 


tradeInfoService.init(); 
Collection < Trade < Long, String, Long >> allTrades = 
tradeInfoService.getAllTrades(); 
LOG. info ("#HHHHHHHHHEHHHHH Dumping All Trades ###HHHHHHHHHHHHH" ) ; 
for (Trade < Long, String, Long > trade: allTrades) { 

LOG. info( 

String. format ("Units=%d, Side=%s , Instrument=%s,, Price=%2.5f", 

trade.getUnits(), 

trade.getSide(), trade.getInstrument().getInstrument(), 
trade. getExecutionPrice())); 

} 
int chfTrades = tradeInfoService. findNetPositionCountForCurrency 
("CHF") ; 
int cadTrades = tradeInfoService. findNetPositionCountForCurrency 
("CAD") ; 
LOG.info("Net Position for CHF = " + chfTrades); 
LOG.info("Net Position for CAD = " + cadTrades); 
TradeableInstrument < String > cadchf = new TradeableInstrument < 
String > ("CAD CHF"); 
TradeableInstrument < String > usdcad = new TradeableInstrument < 
String > ("USD CAD"); 
boolean isCadChdTradeExists = tradeInfoService.isTradeExistsForInstr 
ument (cadchf) ; 
boolean isUsdCadTradeExists = tradeInfoService.isTradeExistsForInstr 
ument (usdcad) ; 
LOG. info(cadchf.getInstrument() + " exists?" + isCadChdTradeExists) ; 
LOG. info(usdcad.getInstrument() + " exists?" + isUsdCadTradeExists) ; 


} 
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Name: TradeinfoServiceDemo 
© ain ee Argumonts = JRE) % Ciasspath | ty Source) Bw Environment | o Common | 
Program arguments: 


https://api-fxtrade.canda.com GvarstRy 
Se LLL LLL ITT ITE | (3 


VM arguments: 


Variables... 
© Use the -XstartOnFirstThread argument when launching with SWT 


Working directory: 


© Defauit: 
©) Other: 


Figure 6-8. Launch configuration 


cterminated> TradeinfoServiceDemo [Java Application] /Uibrary/Java/JavaVirtualMachines/jck1.7.0_71 jdk/Contents/Home/bin/java (27 Jan 2016 19:48:20) 
INFO [main] - Executing request : GET https://opi-fxtrade.conda.com/vi/accounts ?usernome-Cmamahmay HTTP/1.4 
INFO [main] - Executing request : GET https://opi-fxtrade.canda.com/vi/accounts/ Meme HTTP/1. 
INFO [main] - Executing request : GET https://api-fxtrode.canda.com/vi/accounts/4e7722HTTP/1. 
INFO [main] - Executing request : GET https://opi-fxtrode.canda. com/vi/accounts/S@6Q@@ HTTP/1. 
INFO [main] - Executing request : GET https://opi-fxtrade.canda.com/vi/accounts/S9P HITP/1. 
INFO [main] - Executing request : GET https://opi-fxtrode.canda.com/vi/accounts/S9SOG8HTTP/1. 
INFO [main] - Executing request : GET https://opi-fxtrode.canda.com/vi/accounts/PSOPORPHTTP/1. 


BRR BBE 


2016-01- 27 


2016-01-27 INFO [main] - Executing request : GET https://opi-fxtrade.canda.com/vi/accounts/FEWwI trades HTTP/1.1 
2016-01-27 INFO [main] - Executing request : GET https://opi-fxtrade.canda.com/vi/accounts/4eeeeer trades HTTP/1.1 
2016-01-27 INFO [main] - Executing request : GET https://opi-fxtrode.ocanda.com/vi/accounts/S@6SGGr trodes HTTP/1.1 


2016-01-27 
2016-01-27 
2016-01-27 
2016-01-27 
2016-01-27 
2016-01-27 


INFO [main] - Executing request : GET https://api-fxtrode.canda.com/vi/accounts/Pae9PPFtrades HTTP/1.1 
INFO [main] - Executing request : GET https://opi-fxtrode.canda.com/vi/accounts/Sa99eer trades HTTP/1.1 
INFO [main] - Executing request : GET https://api-fxtrode.canda.com/vi/accounts/7OPeey trades HTTP/1.1 
INFO [main] - ##eseeeesesenees Dumping All Trades sseseseusesoonns 
INFO [main] - Units~3000,Side-LONG, Instrument-NZ0_SGD,Price-1.01932 
INFO [main] - Units~3000,Side-LONG, Instrument~AUD_CHF ,Price-@.77415 
INFO [main] - Units~300@,Side-SHORT, Instrument~GBP_AUD,Price-1. 79664 
INFO [main] - Units-3000,Side-LONG, Instrument-AUD_USO, Price-@.82248 
INFO [main] - Units~3822,Side-SHORT, Instrument~EUR_CAD, Price-1.27699 
INFO [main] - Units-5252,Side-SHORT, Instrument~EUR_AUD, Price-1.16897 
INFO [main] - Units~3000,Side-LONG, Instrument-CAD_CHF ,Price-@. 85469 
INFO [main] - Units~3000,Side-LONG, Instrument~EUR_USD, Price=1.23287 
INFO [main] - Units~600@,Side=SHORT, Instrument=USD_NOK, Price-6.09931 
INFO [main] - Units~3000,Side-LONG, Instrument-CAD_SGD,Price=1.11388 
INFO [main] - Units~3000,Side-SHORT, Instrument=GBP_NZD,Price=2.07980 
INFO [main] - Units=6000,Side=LONG, Instrument=NZD_USD, Price-@.83445 
INFO [main] - Units~4999,Side-SHORT, Instrument~GBP_CAD,Price-1.69898 
INFO [main] - Net Position for CHF ~ -2 
INFO [main] - Net Position for CAD = 4 
26,702 INFO [main] - CAD_CHF exists?true 
2016-01-27 19:48:26,702 INFO [main] - USO_CAD exists?false 


Figure 6-9. Sample output 


158 


CHAPTER 7 


Event Streaming: Trade/ 
Order/Account Events 


Events are generated on a trading platform when a state of an order/trade/account or any 
other entity changes on the platform. Here are some examples that could trigger an event: 


e —_ Limit order filled 
e _ Trade stopped out 
e Margin closeout of account 


We will discuss many such state-changing events later in the chapter and how we 
handle them but will focus on events that affect only trades/orders and accounts. 

As discussed in the introduction of the book, we need to create an infinite event loop 
in order to receive the state changes that happen on the platform. The platform, via the 
event stream, just like market data stream, pushes these events and we need to adopt 
the same paradigm to process these events. However, there is one stark difference. The 
market data stream (excluding heartbeats) only has tick events that conform to a standard 
payload. However, with the event stream, we could have differing payloads depending on 
what state change happened on what entity. For example, when a limit order is filled on 
the OANDA platform’, a response like this one is normally sent down the event stream: 


{ 

"transaction": { 
"id": 10002, 
"accountId": 123456, 
"time": "1443968041000000", 
"type": "ORDER FILLED", 
"instrument": "EUR USD", 
"units": 10, 
"side": "sell", 
"price": 1, 
"pl": 1.234, 


OW ON DU BWN PR 
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17 
18 
19 
20 
21 
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OO ON DAU BWN PR 


PRPPRPRPRB 
AuBWNB 


"interest": 0.034, 

"accountBalance": 10000, 

"orderId": 0, 

"tradeReduced": { 
"id": 54321, 
"units": 10, 
"pl": 1.234, 
"interest": 0.034 

} 

} 
} 


On the other hand, when a trade is stopped out, we could see the following response: 


{ 

"transaction": { 
"id": 10004, 
"accountId": 234567, 
"time": "1443968081000000", 
"type": "STOP_LOSS FILLED", 
“tradeId": 1782812741, 
"instrument": "USD SGD", 
"units": 3000, 
"side": "sell", 
"price": 1.39101, 
"pl": 3.3039, 
"interest": -0.0123, 
“accountBalance": 5915.8745 

} 


Looking at these varied responses, we need to create event handlers for each of the 


event types that we are interested in handling. This is where we get the chance to exploit 
the polymorphic behavior of Google EventBus, which would try to deliver the message to 
an exact type if found and then proceed to its supertypes. 


Let’s summarize the different important events that we might see being callbacked 


for. This is by no means a full list, but are the ones that we see often on various platforms 
and will discuss in greater detail later: 
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1. Order 
e Create New Market Order 
e Create New Limit Order 
e Order Update 
e =©Order Cancelled 
e Order Filled 
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2. Trade 
e = Take Profit Filled 
e Stop Loss Filled 
e Trade Update 
e Trade Closed 

3. Account 
e Margin Closeout 


e Financing (Interest Paid or Received) 


Streaming Event Interface 


The first step is to define an interface that establishes the event loop with the platform. 
This is exactly similar in concept to a market data streaming interface. After establishing 
the event loop, all the events are delegated to the appropriate event handlers via the 
EventCallback that we shall discuss soon. First let’s quickly look at this interface: 


/** 

* A service that provides trade/order/account related events 

* streaming. Normally the implementation would create a dedicated 

* connection to the platform or register callback listener(s) to 
receive 

events. It is recommended that the service delegate the handling of 
events to specific handlers which can parse and make sense of the 
different plethora of events received. 


BWN PR 


WwW CON DU 
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10 */ 

11 public interface { 

12 

13 /** 

14 * Start the streaming service which would ideally create a 

15 * dedicated connection to the platform or callback listener(s). 
16 * Ideally multiple connections requesting the same event types 
17 * should not be created. */ 

18 void startEventsStreaming(); 

19 

20 /** 

21 * Stop the events streaming services and dispose any 

22 * resources/connections in a suitable manner such that no resource 
23 * leaks are created.*/ 

24 void stopEventsStreaming(); 

25 } 
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The definition of EventCallback that must be used in tandem to disseminate the 
events is: 


public interface EventCallback<T> { 


1 
2 
3 void onEvent(EventPayLoad<T> eventPayLoad) ; 
4 


} 


These two interfaces have similar design objectives as that of the market data ones. 
The real differences emerge in the downstream dissemination of these different payloads, 
which we will soon discover when the EventBus enters the scene. But before that, let’s 
quickly look at the OANDA implementation for EventsStreamingService. 


A Concrete Implementation for 
EventsStreamingService 


Let’s kick start the discussion of this implementation by looking at the class definition and 
its constructor: 


1 public class OandaEventsStreamingService extends OandaStreamingService 

2 implements EventsStreamingService { 

3 

4 private static final Logger LOG = 

5 Logger. getLogger (OandaEventsStreamingService.class) ; 

6 private final String url; 

7 private final AccountDataProvider < Long > accountDataProvider; 

8 private final EventCallback < JSONObject > eventCallback; 

9 

10 public OandaEventsStreamingService(final String url, final String 
accessToken, 

11 AccountDataProvider < Long > accountDataProvider, EventCallback < 

JSONObject > 
12 eventCallback, 
13 HeartBeatCallback < DateTime > heartBeatCallback, String 


heartBeatSourceld) { 
14 super(accessToken, heartBeatCallback, heartBeatSourceld) ; 
15 this.url = url; 
16 this.accountDataProvider = accountDataProvider; 
17 this.eventCallback = eventCallback; 
18 =} 


Similar to OandaMarketDataStreamingService, this class extends from the 
OandaStreamingService, which provides the infrastructure methods for all OANDA 
streaming services, as discussed. Apart from the usual params, url and accessToken 
passed in, the params HeartBeatCallBack and heartBeatSourceld are required for 
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the super class, we also need the AccountDataProvider service that provides the list of 
accounts we want event callbacks for. These accounts must be passed as parameters in 
the streaming URL as shown: 


1 
2 
3 
4 
5 
6 
7 
8 
9 


@Override 

protected String getStreamingUrl1() { 

Collection < Account < Long >> accounts = 
accountDataProvider.getLatestAccountInfo(); 

return this.url + OandaConstants.EVENTS RESOURCE + "?accountIds=" + 
accountsAsCsvString (accounts) ; 


} 


private String accountsAsCsvString(Collection < Account < Long >> 
accounts) { 
StringBuilder accountsAsCsv = new StringBuilder(); 
boolean firstTime = true; 
for (Account < Long > account: accounts) { 
if (firstTime) { 
firstTime = false; 
} else { 
accountsAsCsv.append(TradingConstants.ENCODED_COMMA) ; 
} 


accountsAsCsv.append(account.getAccountId()); 


} 


return accountsAsCsv.toString(); 


} 


The accountDataProvider.getLatestAccountInfo() returns a collection of all 


accounts that belong to the user. This collection is then passed to accountsAsCsvString, 
which returns a CSV (URL encoded)-separated list of accounts. Assuming the user 
has accounts 123456 and 2345678, the function getStreamingUrl should compute the 


following: 

1 = //given 

2 public static final String EVENTS RESOURCE = "/v1i/events"; 

3 //the url computed will look like 

4 https://stream-fxtrade.oanda.com/v1/events ?accountIds=123456%2C2345678 


With the streaming URL now computed, we are ready to start streaming in an infinite 


loop in a separate thread, which is the same paradigm we used for the market data event 


stream. 

1 @Override 

2 public void startEventsStreaming() { 

3 stopEventsStreaming() ; 

4 streamThread = mew Thread(new Runnable() { 
5 
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6 @Override 

7 public void run() { 

8 CloseableHttpClient httpClient = getHttpClient(); 

9 try { 

10 BufferedReader br = setUpStreamIfPossible(httpClient) ; 


11 if (br != null) { 


12 String line; 

13 while ((line = br.readLine()) != null && serviceUp) { 

14 Object obj = JSONValue.parse(line) ; 

15 JSONObject jsonPayLoad = (JSONObject) obj; 

16 if (jsonPayLoad.containsKey(heartbeat)) { 

17 handleHeartBeat (jsonPayLoad) ; 

18 } else if (jsonPayLoad.containsKey(transaction)) { 

19 JSONObject transactionObject = (JSONObject) 

20 jsonPayLoad.get (transaction) ; 

21 String transactionType = transactionObject.get(type).toString(); 
22 /*convert here so that event bus can post to an appropriate 
23 * handler event though this does not belong here*/ 

24 EventPayLoad < JSONObject > payLoad = OandaUtils 

25 . to0andaEventPayLoad(transactionType, transactionObject) ; 
26 if (payload != null) { 

27 eventCallback.onEvent (payLoad) ; 

28 } 

29 } else if (jsonPayLoad.containsKey(OandaJsonKeys.disconnect)) { 
30 handleDisconnect (line) ; 

31 } 

32 } 

33 br.close(); 

34 } 

35 

36 } catch (Exception e) { 

37 LOG.error(e); 

38 } finally { 

39 serviceUp = false; 

40 TradingUtils.closeSilently(httpClient) ; 

41 } 

42 } 


43 }, "OandEventStreamingThread") ; 
44 streamThread.start(); 
45  } 


The code looks very similar to the market data example, except for these lines where 
something different is happening: 


1 aif (jsonPayLoad.containsKey(transaction)) { 

2 JSONObject transactionObject = (JSONObject) jsonPayLoad. 
get(transaction) ; 

3 String transactionType = transactionObject.get(type).toString(); 
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4 /*convert here so that event bus can post to an appropriate handler, 

5 * event though this does not belong here*/ 

6 EventPayLoad < JSONObject > payLoad = OandaUtils.toOandaEventPayLoad 
(transactionType, 

7 transactionObject) ; 

8 if (payload != null) { 

9 eventCallback.onEvent (payLoad) ; 

Od 


This snippet of code is where most of the magic seems to happen. All the JSON 
payloads for an event have the key transaction. Therefore if our payload has this key, 
we know it’s a platform event that we need to handle. Here we bring in the concept of 
fine-grained event handling by the EventBus. Remember from our introduction of the 
EventBus, it is up to the developer to decide how fine- or coarse-grained you want the 
subscribers or handlers to be. We really want to exploit this feature to our advantage 
by going as fine-grained as possible. Therefore we create payloads that derive from 
the EventPayLoad class and then create handlers with methods that handle specific 
subclasses of EventPayLoad. Let’s first define this parent class of all events: 


41 /[** 

2 * Interface to be implemented by platform events. The implementers 

3 * of this interface would be enums which already have the method 

4 * name() implemented. The reason for its existence is to have a base 
5 * implementation of all platform events. 

6 * 

7 */ 

8 public interface Event { 

9 String name(); 


10 

1 public class EventPayLoad < T > { 
2 

3 private final Event event; 

4 private final T payLoad; 

5 

6 public EventPayLoad(Event event, T payLoad) { 
7 this.event = event; 

8 this.payLoad = payLoad; 

9} 

10 

11 public Event getEvent() { 

12 return this.event; 

13} 

14 

15 public T getPayLoad() { 

16 return this.payLoad; 

17 } 

18 =} 
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This base class for all event payloads stipulates that we must define a constructor 
that accepts the enum of type Event and payload T. 

From our discussion, it is evident we need a subclass implementation for each of the 
types of expected payloads, i.e., Account, Trade, and Order. 


e §=Account 


1 public enum AccountEvents implements Event { 
2 MARGIN CALL_ENTER, 

3 MARGIN CALL_EXIT, 

4 MARGIN CLOSEOUT , 

5 SET MARGIN RATE, 

6 TRANSFER FUNDS, 

7 DAILY INTEREST, FEE; 

8 


public class AccountEventPayLoad extends EventPayLoad < JSONObject > { 


1 
2 
3 public AccountEventPayLoad(AccountEvents event, JSONObject payLoad) { 
4 super(event, payLoad); 

5} 
6 } 


e Trade 


public enum TradeEvents implements Event { 
TRADE_UPDATE, 
TRADE_CLOSE, 
MIGRATE_TRADE_OPEN, 
MIGRATE_TRADE_CLOSE, 
STOP_LOSS FILLED, 
TAKE_PROFIT FILLED, 
TRAILING STOP_FILLED; 


W CON DU BWN PR 


} 


public class TradeEventPayLoad extends EventPayLoad < JSONObject > { 


public TradeEventPayLoad(TradeEvents event, JSONObject payLoad) { 
super(event, payLoad) ; 


NOW PWN PR 


e Order 
1 public enum OrderEvents implements Event { 


2 MARKET_ORDER_CREATE, 
3 STOP_ORDER_CREATE, 
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4 LIMIT ORDER CREATE, 
5 MARKET_IF_ TOUCHED ORDER CREATE, 
6 ORDER_UPDATE, 
7 
8 
9 


ORDER_CANCEL, 
ORDER_FILLED; 


public class OrderEventPayLoad extends EventPayLoad < JSONObject > { 


private final OrderEvents orderEvent; 


super(event, payLoad); 
this.orderEvent = event; 


} 


10 @Override 

11 public OrderEvents getEvent() { 
12 return this.orderEvent; 
13} 

14 

a 


1 
2 
3 
4 
5 public OrderEventPayLoad(OrderEvents event, JSONObject payLoad) { 
6 
7 
8 
9 


Now what remains is to convert the JSON payload into an instance of EventPayLoad, 
which is accomplished by OandaUtils.to0andaEventPayLoad(). This method requires 
a type, which is passed in the event JSON payload and helps determine which business 
entity this event relates to, i.e., Trade, Order, or Account. The type actually is the name of 
an event in one of our three enums. 


1 public static EventPayLoad < JSONObject > toOandaEventPayLoad(String 
transactionType, JSONObject payLoad) { 

2 Preconditions.checkNotNull(transactionType) ; 

3 Event evt = findAppropriateType(AccountEvents.values(), 

transactionType) ; 

4 if (evt == null) { 

5 evt = findAppropriateType(OrderEvents.values(), transactionType) ; 

6 if (evt == null) { 

7 evt = findAppropriateType(TradeEvents.values(), transactionType) ; 

8 if (evt == null) { 

9 return null; 


10 } else { 

11 return new TradeEventPayLoad((TradeEvents) evt, payLoad); 
12 } 

13 } else { 

14 return new OrderEventPayLoad((OrderEvents) evt, payLoad); 
15 } 
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16 } else { 

17 return new AccountEventPayLoad((AccountEvents) evt, payLoad); 

18 } 

19 

20 +} 

21 

22. private static final Event findAppropriateType(Event[] events, String 
transactionType) { 

23 for (Event evt: events) { 

24 if (evt.name().equals(transactionType)) { 


25 return evt; 
26 } 

27 } 

28 return null; 
29} 


This utility method does a brute force comparison of all three event types we have 
and returns as soon as it finds the first match. If no match is found (it is possible if a new 
event is introduced by the platform), it returns nu11. If we do have a non-null instance 
of the EventPayLoad, we are now ready to dispatch it to an instance of EventCallback, 
which inevitably must use the EventBus to dispatch to the interested subscribers. 


public class EventCallbackImpl < T > implements EventCallback < T > { 
private final EventBus eventBus; 


1 

2 

3 

4 

5 public EventCallbackImp1l(final EventBus eventBus) { 
6 this.eventBus = eventBus; 
7 

8 

9 

0 


} 


@O0verride 


1 public void onEvent(EventPayLoad < T > eventPayLoad) { 
11 this .eventBus.post(eventPayLoad) ; 

12 } 

13 

14 } 


At the time onEvent method is invoked, it already has an appropriate subtype of the 
EventPayLoad, ready to be dispatched. 

Since we want to exploit the fine-grained dispatching of the subtypes of 
EventPayLoad by the EventBus, we need to create payload handlers that can 
polymorphically handle these specific payloads. To achieve that, we need to first define 
an EventHandler interface that has a method to do exactly that. 
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public interface EventHandler<K, T extends EventPayLoad<K>> { 


void handleEvent(T payLoad) ; 
} 


BWNB 


In this definition, we are stipulating that the handleEvent will handle events that are 
subtypes of EventPayLoad 

For the set of events relating to the Trade business entity, an implementation of the 
TradeEventHandler would look like this: 


1 public class TradeEventHandler implements EventHandler < JSONObject, 
2 TradeEventPayLoad > { 

3 

4 private final Set < TradeEvents > tradeEventsSupported = 

5 Sets .newHashSet (TradeEvents.STOP_LOSS FILLED, 

6 TradeEvents. TRADE CLOSE, TradeEvents.TAKE PROFIT FILLED); 

7 private final TradeInfoService < Long, 

8 String, 

9 Long > tradeInfoService; 

10 

11 public TradeEventHandler(TradeInfoService < Long, String, Long > 
12 tradeInfoService) { 

13 this.tradeInfoService = tradeInfoService; 

14 } 

15 

16 @Override 

17 @Subscribe 

18 @AllowConcurrentEvents 

19 public void handleEvent(TradeEventPayLoad payLoad) { 

20 Preconditions .checkNotNull(payLoad) ; 

21 if (!tradeEventsSupported.contains(payLoad.getEvent())) { 

22 return; 

23 } 

24 JSONObject jsonPayLoad = payLoad.getPayLoad(); 

25 long accountId = (Long) jsonPayLoad.get(OandaJsonKeys.accountId) ; 
26 tradeInfoService. refreshTradesForAccount(accountId) ; 

27 } 

28 =} 


The TradeEventHandler handles the TradeEventPayLoad payload as per its 
definition. There are couple of things worth noting about this simple handler. First it 
stipulates through the tradeEventsSupported set which subset of all trade events it wants 
to consume. Hence one of the first things it does is perform the check 


1 if (!tradeEventsSupported.contains(payLoad.getEvent())) { 


2 return; 


3 } 
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and promptly return if the type is not in [STOP_LOSS FILLED, TRADE CLOSE, TAKE_ 
PROFIT FILLED]. If itis, then it does a very interesting action of refreshing the trades cache. 
Remember, from our discussion from previous chapter, that TradeInfoService has an 
internal cache of trades, in order to avoid making frequent calls to fetch trades, which is 
quite expensive. Now, here it is where this cache gets refreshed. We only refresh the trades 
cache for the given account and resist refreshing everything, as it is not required here. 

An equivalent handler for orders is the OrderFilledEventHandler whose definition is: 


RB 


public class OrderFilledEventHandler implements EventHandler < 
JSONObject, 

2 OrderEventPayLoad > , EmailContentGenerator < JSONObject > { 
3 private final Set < OrderEvents > orderEventsSupported = 

4 Sets .newHashSet (OrderEvents.ORDER_ FILLED) ; 

5 private final TradeInfoService < Long, 

6 String, 

7 Long > tradeInfoService; 

8 

9 

0 


public OrderFilledEventHandler( 


1 TradeInfoService < Long, String, Long > tradeInfoService) { 
11 this.tradeInfoService = tradeInfoService; 

12 } 

13 


14 @Override 
15 @Subscribe 


16 @AllowConcurrentEvents 

17 public void handleEvent(OrderEventPayLoad payLoad) { 

18 Preconditions.checkNotNull(payLoad) ; 

19 if (!orderEventsSupported.contains(payLoad.getEvent())) { 
20 return; 

21 } 

22 JSONObject jsonPayLoad = payLoad.getPayLoad(); 

23 

24 long accountId = (Long) jsonPayLoad.get(OandaJsonKeys.accountId) ; 
25 tradeInfoService.refreshTradesForAccount (accountId) ; 

26 } 

27} 


As the name of this handler suggests, we are only interested in the ORDER_FILLED 
event. When an order is filled, a trade is created as a result. Therefore, we refresh the 
trades cache again by invoking tradeInfoService.refreshTradesForAccount. 

Coming back to the dissemination by the EventBus, since we are creating payloads 
of the types TradeEventPayLoad, OrderEventPayLoad, and AccountEventPayLoad and 
have methods with @Subscribe that match the types, the EventBus should deliver to the 
relevant handleEvent method and not to all three. 

This concludes our discussion of the events related to Trade, Order, and Accounts. 
There are several other things that you might choose to do when such events happen, for 
example, send an e-mail or an SMS notification. It is up to developers to decide what to 
write in the handleEvent method. 
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Try It Yourself 


In this section we are going to create a demo program that will output events from the 
platform. To see this in action and see the LIMIT ORDER_CREATE event outputted, run the 
OrderExecutionServiceDemo program. It will create a new order, which will generate a 
platform event. The demo program will process and output it. 
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package com.precioustech. fxtrading.oanda.restapi.streaming.events ; 


import 
type; 


import 
import 
import 


import 
import 
import 
import 
import 
import 
import 
import 
import 
import 


static com.precioustech. fxtrading.oanda.restapi.OandaJsonKeys. 


org. apache. log4j.Logger; 
org. joda.time.DateTime; 
org. json.simple.JSONObject ; 


com. google. common.eventbus.AllowConcurrentEvents ; 

com. google.common.eventbus.EventBus ; 

com. google.common.eventbus. Subscribe; 
com.precioustech. fxtrading. account. AccountDataProvider ; 
com.precioustech. fxtrading.events.EventCallback; 
com.precioustech. fxtrading.events.EventCallbackImp1 ; 

com. precioustech. fxtrading.events.EventPayLoad; 
com.precioustech. fxtrading.heartbeats.HeartBeatCallback; 
com.precioustech. fxtrading. heartbeats .HeartBeatCallbackImp1 ; 
com.precioustech. fxtrading.oanda.restapi.account. 


OandaAccountDataProviderService ; 


import 


com.precioustech. fxtrading. streaming.events. 


EventsStreamingService ; 


public 


class EventsStreamingServiceDemo { 


private static final Logger LOG = Logger.getLogger(EventsStreamingSer 
viceDemo.class); 


private static void usage(String[] args) { 
if (args.length != 4) { 


LOG. 


error("Usage: EventsStreamingServiceDemo <url> <url2> <username> 


<accesstoken>"); 
System.exit(1); 


} 
} 
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32 private static class EventSubscriber { 


33 

34 @Subscribe 

35 @AllowConcurrentEvents 

36 public void handleEvent(EventPayLoad < JSONObject > payLoad) { 

37 String transactionType = payLoad.getPayLoad().get(type).toString(); 

38 LOG. info(String.format("Type:%s, payload=%s", transactionType, 
payLoad.getPayLoad())); 

39 } 

40 } 

41 


42 public static void main(String[] args) throws Exception { 

43 usage(args) ; 

44 String url = args[0]; 

45 String url2 = args[1]; 

46 String userName = args[2]; 

47 String accessToken = args[3]; 

48 final String heartBeatSourceId="DEMO_EVTDATASTREAM" ; 

49 

50 EventBus eventBus = new EventBus(); 

51 eventBus.register(mew EventSubscriber()); 

52 HeartBeatCallback < DateTime > heartBeatCallback = new 
HeartBeatCallbackImpl < DateTime > (eventBus); 

53 AccountDataProvider < Long > accountDataProvider = 

54 new OandaAccountDataProviderService(url2, userName, accessToken); 

55 EventCallback < JSONObject > eventCallback = new EventCallbackImpl < 
JSONObject > (eventBus); 


56 

57 EventsStreamingService evtStreamingService = 

58 new OandaEventsStreamingService(url, accessToken, 

59 accountDataProvider, eventCallback, heartBeatCallback, 
heartBeatSourcelId) ; 

60 evtStreamingService.startEventsStreaming(); 

61 //Run OrderExecutionServiceDemo in the next 60s 

62 Thread.sleep(60000 L); 

63 evtStreamingService.stopEventsStreaming() ; 

64 } 

65} 
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Name: EventsStreamingServiceDemo 


(© main (eamuments. i Re) %y clesspatn| 7 Souree| BB Envenment [Comme 


Program arguments: 
https://stream-fxtrade.oanda.com https://api-fxtrade.canda.com eraranrEy 
6 
Variables... 
VM arguments: 
Variables... 


© Use the -XstartOnFirstThread argument when launching with SWT 


Working directory: 


© Defautt: 
©) Other: 


Figure 7-1. Launch configuration 


© sevesce | Premtens © Ceweration ff Sewer Sj Progress CD) Coreoe Ef fi] tasxcet 2) tases ab Coverage yon staging if Haney R% 4228 -0-n-°8 


Laewe Aopicetion! (Uorery devel erelrtes Mecreren lee’ 70 71 iga/Cortertahsome/oniave (27 Jon 2016 204066) 

(Donal vent StreamingThread) - Cancuting request © GET https: //ap\-fatrate conde. con/y?/eccount s?usernone-qammatammpehTT#/1. 1 

(Qondl ventStreewingThread) - Cascuting reesest © GLT Mts: //ap) -(atrade cards. com/vi/eccount s/PRRPRPNTTP/E. + 

(Gena ventStreewingthread) - Caccuting reesest : GIT Mtoe: //api-fatrade.conds. con/vi/eccount s/OOPPRP MTTP/L.2 

(GendiventStreewingthread) - Lxccuting request : CLT https: //api-fxtrate.conds. con/vi/eccounts/SRRORONTTP/1. 5 

(Denali vertStreewingThread) - Lxecuting reqvest : CLT Mttps://ap)-fatrade. cards. con/vi/eccownts/ SORRNTTP/L.S 

(QonaiventStreawingthrend) - Lxecuting request : GET https: //api-fxtrate conde. con/vi/eccount s/SFFFNPMTTP/T. 1 

(QonatventStreamingThread) - Executing request ' GET https: //ap\-fatrade conde. com/vi/eccount s/PRRPMTTP/E 1 

[Qonal wene St reewingTivea) — Caecet ing mequest | GET MEL ps //etreem: fatrade conde Con/el/events oc et lt Ati —n—ttte CTT. 
(Gendt ventStreamingthread) ~ Type LIMIT ORDER CREATE, paylocde{*id* SORORIRORRR, “LokeProfi\Price”:1.44, "time" “145082421 2000008" “price” 1.4,* 


Figure 7-2. Sample output 
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Integration with Twitter 


We have now reached probably the most exciting part of our journey in building the 
trading bot. Interacting with social media is probably one of the most important things 

a bot should be able to do. It probably wasn’t important a few years ago but now it is 
extremely so because most news, events, and leaks seem to appear on social media first, 
which affect the markets. The ability to subscribe to these feeds in realtime, make sense of 
them and make a decision, adds a layer of sophistication to any bot. Ours is no exception, 
except that we will not attempt to consume thousands of tweets per second but learn 

the basics of integrating with Twitter. We aim to achieve the following by the end of this 
chapter: 


° Connect to a Twitter account 
e Search for tweets 
e _ Parse tweets and make sense of them 


In particular, we will focus on FX tweets from users whose tweets have a well defined 
structure and have information about orders and trades. The idea is that by doing so, we 
can build a strategy to copy what others are doing and maybe either do what they are 
doing or do the opposite. This will be discussed in detail in the next chapter, as part of a 
strategy that involves this concept. 


Creating a Twitter Application 


Before we can automate the process of tweeting and reading tweets automatically via 

a user account, we need to associate a Twitter app to the user account. The tokens 
generated for this app will be used to log in to Twitter and perform the required 
operations via the bot. Let’s follow the step-by-step procedure to get to a state where we 
have the necessary tokens to connect via a Java application. 


1. Gotohttps://apps.twitter.com/app/new', where you will 
see the screen shown in Figure 8-1. 


'https://apps.twitter.com/app/new 
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Create an application 


Application Details 
Name * 


MyTradingBot 


Description * 


This app will be used by @ bot fo automatically use my account to read and publish tweets 


Website * 


Mttpy/www. twitter.com 


Callback URL 


Developer Agreement 


Effectwe: May 18, 2015. 


This Twitter Developer Agreement (Agreement’) is made between you (ether an individual or an entity, referred to herein as “you") and 
Twitter, inc. and Twitter International Company (collectively. “Twitter”) anc governs your access to and use of the Licensed Material (as 
defined below! 


Figure 8-1. Creating an app for bot 


2. After accepting the agreement and submitting the form, you 
should see the confirmation screen shown in Figure 8-2. 
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Your application has been created. Piease take a moment to review and adjust your application's settings. 


MyTradingBot 


Octails Settings Keys anc Access Tokens Permissions 


This app wil be used by a bot to automatically use my account to read and publish tweets 
hittpo/wraw. twitter.com 


Organization 
Organization None 
Organization website None 
Application Settings 
authenticate 
Access level Read and write (modify app perrmssions) 
Consumer Key (API Key) ee 
tokens) 
Callback URL None 
Callback URL Locked No 
Sign in with Twitter Yes 


App-only authentication —_nnttips://api.twitter.corvoauth2/token 


Request token URL Nttps.//api.twitter.com/oautiVrequest_token 
Authorize URL https://apl.twitter.conVoauth/authorize 
Access token URL hittps-//api.twitter.convoauthVaccess_token 


Application Actions 


Figure 8-2. Twitter app created successfully 


INTEGRATION WITH TWITTER 


Test OAuth 


3. While on the confirmation screen, you must now click on 
the Keys and Access Tokens tab, where you should see the 
Consumer Key Token and Consumer Key Secret display 
(see Figure 8-3). Make a note of these tokens, as you will need 


them later. 
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MyTradingBot Test OAuth 


Octats Settings Keys and Access Tokens Permissions 


Application Settings 


Consumer Key (API Key) 8SgFqaQ1zVgZD5FacbbBBaux 


Consumer Secret (API Secret) | AT 


Access Level Read and write (modify app permissions) 
Owner shwarshney 
Owner ID 1318109634 


Application Actions 


Regenerate Consumer Key and Secret Change App Permissions 


Your Access Token 


Token Actions 


Create my access token 


Figure 8-3. Consumer tokens 


4. You can now create the other access tokens. Click on the 
button below Token Actions to generate the tokens. You 
should see the screen shown in Figure 8-4. 
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Details Settings Keys and Access Tokens Permissions 
Application Settings 
Consumer Key (AP| Key) ©:S:amutaaniateaeiaiaitletss: 
Consumer Secret (API Secret) ett 
Access Level Read and write (modily app permissions) 
Owner shvarshney 
Owner ID 1318109634 


Application Actions 


Regenerate Consumer Key and Secret Change App Permissions 


Your Access Token 

Access Token 1318109634. 
A 

Access Token Secret NATE STE RE 

Access Level Read and write 

Owner shwarshney 

Owner ID 1318109634 


INTEGRATION WITH TWITTER 


Test OAuth 


Figure 8-4. Authorization tokens 


You should now have the following four tokens, which are required for the trading 


bot app to log in using your account. 
e Consumer key 
e Consumer secret 
e = Access key token 


e Access key secret 
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Spring Social 


Spring Social* is the de facto choice when it comes to integrating with social media 
applications like Facebook, Twitter, LinkedIn, etc. It provides all the plumbing required to 
connect with a given social media network, leaving you to focus with implementing the 
logic to mine data from/post data to these networks. Developers who have used Spring 
before will recognize the same pattern being used for JMS* and JDBC’, where all the 
middleware and database plumbing, respectively, is taken care by Spring. 

For this discussion, we will solely focus on integrating our bot with Twitter’. 


Using and Configuring Spring Social 


We need to add the following dependencies to the maven pm. xml file in order to bring 
Spring Social into the bot ecosystem. 


1 <dependency> 

2 <groupId>org.springframework.social</groupId> 
3 <artifactId>spring-social-twitter</artifactId> 
4 <version>1.1.0.RELEASE</wersion> 

5 </dependency> 


The interaction with Twitter happens via the TwitterTemplate, ° which needs to 
be configured in the Spring configuration file using the tokens we generated when we 
defined our Twitter app. 


1 <bean id="twitter" class="org.springframework.social.twitter.api.impl. 
TwitterTemplate"> 


2 <constructor-arg index="0" value="${twitter. 
consumerKey}"/> 

3 <constructor-arg index="1" value="${twitter. 
consumerSecret}"/> 

4 <constructor-arg index="2" value="${twitter. 
accessToken}"/> 

5 <constructor-arg index="3" value="${twitter. 


accessTokenSecret}"/> 
6 </bean> 


With this code, TwitterTemplate is ready to be injected in any services. 


*http://docs.spring.io/spring-social/docs/1.0.x/reference/html/overview. html 
3http://docs.spring.io/spring/docs/current/javadoc-api/org/springframework/jms/ 
core/JmsTemplate. html 
“‘http://docs.spring.io/spring/docs/current/javadoc-api/org/springframework/jdbc/ 
core/JdbcTemplate. html 

https: //dev.twitter.com/overview/documentation 
Shttp://docs.spring.io/spring-social-twitter/docs/1.0.5.RELEASE/api/org/ 
springframework/social/twitter/api/imp1/TwitterTemplate.html 
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Harvesting FX Tweets 


Now we come to the meat of the chapter, where we discuss how to harvest (search) well 
structured trade/order tweets. Our aim is to find well structured tweets that can be parsed 
to create the following POJOs. 


33 


e NewFXTradeTweet 


public class NewFXTradeTweet < T > extends FXTradeTweet < T > { 
private final double stopLoss, 

takeProfit; 

private final TradingSignal action; 

private final String str; 


public NewFXTradeTweet (TradeableInstrument < T > instrument, double 

price, 

double stopLoss, double takeProfit, 

TradingSignal action) { 

super(instrument, price); 

this.stopLoss = stopLoss; 

this.takeProfit = takeProfit; 

this.action = action; 

this.str = String. format("%s@%3.5f TP: %3.5f: SL: %3.5f %s", 
instrument.getInstrument(), price, takeProfit, 
stopLoss, action.name()); 


} 


@Override 
public String toString() { 
return str; 


} 


public TradingSignal getAction() { 
return this.action; 


} 


public double getStopLoss() { 
return stopLoss; 


} 


public double getTakeProfit() { 
return takeProfit; 


} 
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e CloseFXTradeTweet 


1 public class CloseFXTradeTweet < T > extends FXTradeTweet < T > { 
2 private final double profit, 

3 price; 
4 
5 


public CloseFXTradeTweet(TradeableInstrument < T > instrument, double 
profit, 

6 double price) { 

7 super(instrument, price); 

8 this.profit = profit; 

9 this.price = price; 

0 


1 } 

11 

12 public double getProfit() { 
13 return profit; 

14 } 

15 


16 @O0verride 

17 public double getPrice() { 
18 return price; 

19} 


21} 
where the base FXTradeTweet is 


1 public abstract class FXTradeTweet < T > { 

2 private final TradeableInstrument < T > instrument; 
3 private final double price; 
4 
5 


public FXTradeTweet(TradeableInstrument < T > instrument, double 
price) { 

6 super(); 

7 this.instrument = instrument; 

8 this.price = price; 
9 
0 


} 
1 
11 public TradeableInstrument < T > getInstrument() { 
12 return instrument; 
13°} 
14 
15 public double getPrice() { 
16 return price; 
17 } 
18 
19} 
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The concept of a well structured trade tweet indicates a set of Twitter users who 
consistently tweet in a given format and for which we can write a TweetHandler. We are 
only interested in their tweets that are about a new order or closing a trade. The reason for 
this will become clearer when we discuss a strategy based on tweets. For the time being, 
let’s look at some examples of tweets from the @SignalFactory’ and @ZuluTrader101° 
users as an illustration. 


e Tweets from @SignalFactory are shown in Figures 8-5 through 8-8. 


Forex Signal Factory 


Forex Signal | Sell CHFUPY@1 23.460 | 
SL:123.860 | TP:122.660 | 2015.12.09 
21:07 GMT | #fx #forex #fb 


«@) 


Figure 8-5. New trade 


((@) Forex Signal Factory 


Forex Signal | Sell EURUSD@1 .08578 | 
SL:1.10000 | TP:1.07000 | 2015.12.31 
19:04 GMT | #fx #forex #fb 


Figure 8-6. New trade 


( »)) Forex Signal Factory 
Forex Signal | Close(TP) Sell 
EURCHF@1.07884 | Profit: +80 pips | 
2015.12.14 10:46 GMT | #fx #forex #fb 


Figure 8-7. Close trade 


(@) Forex Signal Factory 
Forex Signal | Close Sell EURUSD@1.10501 
| Loss: -197 pips | 2015.12.15 09:32 GMT | 
#fx #forex #fb 


Figure 8-8. Close trade 


https ://twitter.com/SignalFactory 
Shttps://twitter.com/ZuluTrader101 
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e Tweets from @ZuluTrader101 are shown in Figures 8-9 and 8-10. 


Zulutrader 101 ©ZuluTrader101 - 1h 

e8 Bought 1.03 Lots #EURUSD 1.08824 SL 
1.08497 TP 1.10314 | Auto-copy FREE at 
goo.gl/moaYzx #Forex #Finance #Money 
4 t 8 
Zulutrader 101 ©ZuluTrader101 - 1h 

B85 Closed Sell 0.19 Lots #EURAUD 1.56 for 
-4.0 pips, total for today -1722.3 pips 
a tt @ one 
Zulutrader 101 @ZuluTrader101 - th 

Bas Closed Sell 0.22 Lots #EURAUD 1.56 for 
-4.0 pips, total for today -1718.3 pips 


a +t? e 
Figure 8-9. New and close trades 


Zulutrader 101 ©ZuluTrader101 - 28m 


gies Sold 1.55 Lots #EURUSD 1.08415 SL 
1.08677 TP 1.08335 | Auto-copy FREE at 
goo.gl/moaYzx #Forex #Finance #Money 
4 vc id 

~ Zulutrader 101 @ZuluTrader101 - 28m 

gies Sold 0.59 Lots #EURUSD 1.08357 SL 
1.0854 | Auto-copy FREE at goo.gl/moaYzx 
#Forex #Finance #Money 
em tt y 
Zulutrader 101 @ZuluTrader101 - 28rr 
5 Closed Sell 0. 19 Lots #GBPUJPY 167.426 
for -48.6 pips, total for today -193.0 pips 


4 ty v 


Figure 8-10. New and close trades 
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Looking at the tweet examples from these two users, notice that there is certain 
format in which they tweet. It then becomes trivial to parse these tweets if we assign 
a dedicated tweet handler that parses tweets from a given user. We will come back to 
discussing the handlers shortly. Before that let’s look at how we search for tweets from 
given users. 


TweetHarvester Interface 


The TweetHarvester interface mandates the search for Tweets for a given user that result 
in a collection of both new/closed trades FX Tweets. Its definition is as follows: 


1 public interface TweetHarvester < T > { 

2 

3 Collection < NewFXTradeTweet < T >> harvestNewTradeTweets (String 
userId); 

4 

5 Collection < CloseFXTradeTweet < T >> harvestHistoricTradeTweets(Stri 
ng userId, 

6 TradeableInstrument < T > instrument); 

7 3 


The first method of the interface is fairly straightforward. This method’s contract 
is to harvest new trade tweets from a given user since the last search was done. The 
implementer is responsible for keeping track of the timeline and should only return the 
new ones. 

The second method’s contract is again to harvest new tweets, this time for closed 
trades since the last search and for a given instrument. 


FXTweetHandler Interface 


As discussed earlier in this chapter, as long as the user consistently tweets in a given 
format, a dedicated handler assigned to that FX new/close trade tweet can parse their 
tweets and create NewFxTradeTweet and CloseFXTradeTweet from them. This interface 
formulates that contract and provides a few other useful methods: 


public interface FXTweetHandler < T > { 
FXTradeTweet < T > handleTweet(Tweet tweet); 


1 
2 
3 
4 
5 String getUserlId(); 
6 
7 Collection < Tweet > findNewTweets(); 
8 
9 


Collection < Tweet > findHistoricPnlTweetsForInstrument ( 
10 TradeableInstrument < T > instrument); 
a 
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The first three interface methods are fairly self-explanatory. The method 
findHistoricPnlTweetsForInstrument requires a bit of explanation. The contract 
for this method is to retrieve all tweets that were posted by a given user for a given 
instrument. They must also be close trade tweets that resulted in a PNL figure. (For 
example, a positive or a negative pip figure result. Refer back to the close trade tweets of 
the two users discussed in this chapter.) This might not make much sense now, but it will 
become clear when we discuss our Twitter-based strategy in the next chapter. 


AbstractFXTweetHandler Base Class 


We start the discussion about the implementation of FXTweetHandler interface by 
defining an abstract class that implements this interface but only implements a couple of 
key methods of the interface—findNewTweets() and getUserId(). 

The implementation of the method findNewTweets () in particular presents us with 
the opportunity to discuss Twitter search API°. The API provides us with comprehensive 
set of query operators that enable us to build a search query and retrieve a collection of 
tweets in reverse chronological order. The response from Twitter is a JSON payload, but 
because we are using TwitterTemplate, Spring takes care of parsing the payload and 
converting it into a collection of org. springframework.social.twitter.api. Tweet 
objects, which are much easier to work with. 


Tip It is strongly recommended that you read the search API page in order to 
understand the operators, the constraints around the results returned, and best practices 
before proceeding further. 


Some examples taken directly and slightly modified from the documentation and 
relevant to our search are as follows: 


Operator Finds Tweets 

from: foo Find tweets from user foo 

from: foo since: 2015-012-01 Find tweets from user foo since 2015-012-01 

from: foo since_id: 10000000 Find tweets from user foo since tweet ID 
10000000 

from: foo Profit: OR Loss: Find tweets from user foo containing certain 


characters (Profit: OR Loss:) 


*https://dev.twitter.com/rest/public/search 
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public abstract class AbstractFXTweetHandler < T > implements 
FXTweetHandler < T > { 


@Autowired 

protected Twitter twitter; 

@Autowired 

protected InstrumentService < T > instrumentService; 
@Autowired 

protected ProviderHelper providerHelper; 


protected final DateTime startTime = DateTime.now(); 
protected final String startTimeAsStr; 

protected volatile Long lastTweetId = null; 

protected final String userId; 

protected static final String CLOSED = "Closed"; 
protected static final String BOUGHT = "Bought"; 
protected static final String SOLD = "Sold"; 

protected static final Logger LOG = 

Logger. getLogger(AbstractFXTweetHandler.class) ; 

static final String FROM_USER SINCE _TIME_TWITTER_ORY_TMPL = 
"from:%s since:%s"; 

static final String FROM_USER_ SINCE ID TWITTER_ORY TMPL = 
"from:%S since _id:%d"; 


protected AbstractFXTweetHandler(String userId) { 

this.userId = userId; 

DateTimeFormatter formatter = DateTimeFormat.forPattern("yyyy-MM-dd") ; 
startTimeAsStr = formatter.print(this.startTime) ; 


} 


protected abstract NewFXTradeTweet < T > parseNewTrade(String 
tokens[]); 


protected abstract CloseFXTradeTweet < T > parseCloseTrade(String 
tokens[]); 


@Override 
public String getUserId() { 
return userId; 


} 

private class TweetPredicate implements Predicate < Tweet > { 
@O0verride 

public boolean apply(Tweet input) { 


return startTime.isBefore(input.getCreatedAt().getTime()); 
} 
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45 

46} 

47 

48 @Override 

49 public Collection < Tweet > findNewTweets() { 


50 SearchResults results = null; 

51 if (lastTweetId == null) { // find new tweets since the start of the 
app 

52 synchronized(this) { 

53 if (lastTweetId == null) { // double check locking 

54 results = twitter.searchOperations().search( 

55 String. format ( 

56 FROM_USER SINCE TIME TWITTER ORY TMPL, getUserId(), this. 

startTimeAsStr) ); 

57 TweetPredicate predicate = new TweetPredicate(); 

58 List < Tweet > filteredTweets = Lists.newArrayList(); 

59 for (Tweet tweet: results.getTweets()) { 

60 if (predicate.apply(tweet)) { 

61 if (lastTweetId == null) { 

62 /*take the first one as the tweets are in reverse 

chronological order */ 

63 this. lastTweetId = tweet.getId(); 

64 } 

65 filteredTweets.add(tweet) ; 

66 } 

67 } 

68 return filteredTweets; 

69 } 

70 

71 } 

72 

72} 


74 results = twitter.searchOperations().search( 
75 String. format ( 

76 FROM_USER_SINCE_ID TWITTER _ORY_TMPL, getUserId(), lastTweetId)); 
77 List < Tweet > tweets = results.getTweets(); 
78 if (!TradingUtils.isEmpty(tweets)) { 

79 lastTweetId = tweets.get(0).getId(); 

80 } 

81 return tweets; 

82 

ae 

84} 


The meat of this class lies in the implementation of the the method findNewTweets (). 
The method tries to retrieve all new tweets since the last API call was made. It is assumed 
that there is a scheduled job that runs at regular intervals and calls this method to fetch 
the newest tweets. In order to retrieve the newest ones since the last call, the class has to 
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internally keep track of the last tweet fetched. By using an ID greater than the last ID for the 
given user, it is able to find all the newest tweets for that user. However, when it is invoked 
for the first time, we need to explore another way to find the newest tweets. In this case, 

we use the time the class was initialized as the starting point to retrieve tweets. This is the 
logic that we see executed when if (lastTweetId == nul1). In order to make the class 
thread-safe, additional synchronization is provided, taking into account the double-check 
locking"’. The time-based approach uses the query from:%s since:%s, where we supply 
the user ID in question and the startup time in the format yyyy-MM-dd. Once this search 
returns results, we can take the first tweet in the collection and set its ID as the latest ID 

to start the next search from. In that case, we use the query string from:%s since_id:%d, 
providing the user ID and the ID set from the last search. Just to reiterate, the search results 
are sorted from newest to oldest. 


User-Specific TweetHandlers 


Warning The tweet format discussed for individual users can change without any 
notice. Therefore, it is imperative that we write defensive code as much as possible for 
parsing purposes. 


To conclude this discussion, we will look at TweetHandlers for the users we 
discussed earlier in the chapter. Most of the code should center on parsing tweets, as it is 
very specific to that user. The functionality that is common, like searching for new tweets 
by a user, is abstracted in the base class AbstractFXTweetHandler, which we discussed in 
the previous section. 

For new trades we are interested in parsing the following information: 


e —- Trade action 
e Instrument pair 
e —_ Limit price 
e Stop loss price 
e Take profit price 
For close trades we want to parse this information: 
e —_ Instrument pair 
e = Close price 


e —_ Profit/loss pips 


Mhttps://en.wikipedia.org/wiki/Double-checked_locking 
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SignalFactoryFXTweetHandler 


This tweet handler attempts to parse new/close trade related tweets published by the user 
@SignalFactory. Just to refresh our minds, let’s look at some examples of new and close 
trade tweets by the user in text form: 


//New Trade 
2 Forex Signal | Sell USDCHF@0.91902 | SL:0.92302 | TP:0.91102 | 
2015.01.30 17:52 GMT | #fx #forex #fb 


w 


4 Forex Signal | Sell GBPAUD@2.03572 | SL:2.03972 | TP:2.02772 | 
2016.01.22 12:40 GMT | #fx #forex #fb 


uw 


6 Forex Signal | Buy GBPCAD@2.03229 | SL:2.02829 | TP:2.04029 | 
2016.01.22 13:56 GMT | #fx #forex #fb 


8 //Close Trade 
9 Forex Signal | Close(SL) Buy NZDCHF@0.66566 | Loss: -40 pips | 
2015.01.30 18:16 GMT | #fx #forex #fb 


11 Forex Signal | Close(TP) Buy GBPCHF@1.44636 | Profit: +80 pips | 
2016.01.22 11:55 GMT | #fx #forex #fb 


13 Forex Signal | Close(SL) Sell GBPAUD@2.03972 | Loss: -40 pips | 
2016.01.22 13:03 GMT | #fx #forex #fb 


For a new trade, we can make the following observations for this user (assuming we 
initially parse the whole tweet by the separator character | and get six tokens): 


e ‘The trade actions are indicated by the words “Buy” or “Sell,” 
which are the first words of the second token. 


e The instrument pair is always the first subtoken obtained from the 
second word of second token split by an @ character. 


e The limit price is the second subtoken obtained from the second 
word of second token split by an @ character. 


e The stop loss price is the second subtoken obtained from the third 
token when split by the : character. 


e The take profit price is the second subtoken obtained from the 
fourth token when split by the : character. 


For a close trade, we can make the following observations for this user (assuming we 
initially parse the whole tweet by the separator character | and get five tokens): 


e The instrument pair is always the first subtoken obtained from the 
third word of the second token split by an @ character. 
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e The close price is always the second subtoken obtained from the 
third word of the second token split by an @ character. 


e The profit/loss is the always the second word of the third token. 


A general observation: 


e A tweet relates to a new trade if the first word of the second token 
is either “buy” or “sell” 


e A tweet relates to a close trade if the first word of the second token 
starts with the word “close”. 


Let’s look at the code that implements these observations. 


1 public class SignalFactoryFXTweetHandler 

2 extends AbstractFXTweetHandler < String > { 

3 private static final String BUY = "Buy"; 

4 private static final String SELL = "Sell"; 

5 private static final String CLOSE = "Close"; 

6 private static final String COLON = ":"; 

7 private static final String AT THE RATE = "@"; 
8 
9 


public SignalFactoryFXTweetHandler(String userid) { 
10 super (userid) ; 
11 } 
12 
13 @O0verride 
14 protected NewFXTradeTweet < String > parseNewTrade(String tokens[]) { 
15 String token1[] = tokens[1].trim().split(TradingConstants.SPACE_RGX); 
16 String action = token1[0]; 
17 String tokensispl[] = token1[1].split(AT_THE_ RATE); 
18 String tokens2[] = tokens[2].trim().split(COLON) ; 
19 String tokens3[] = tokens[3].trim().split(COLON) ; 


20 

21 return new NewFXTradeTweet < String > (mew TradeableInstrument < 
String > (this.providerHelper 

22 . fromIsoFormat(tokensisp1[0])), Double. parseDouble(tokensisp1[1]), 

23 Double.parseDouble(tokens2[1]), Double.parseDouble(tokens3[1]), 

24 BUY.equals(action) ? TradingSignal.LONG : TradingSignal. SHORT) ; 

25} 

26 


27 @O0verride 

28 protected CloseFXTradeTweet < String > parseCloseTrade(String 
tokens[]) { 

29 String token1[] = tokens[1].trim().split(TradingConstants.SPACE_RGX); 

30 String tokensispl[] = tokeni[token1.length - 1].split(AT_THE RATE); 

31 String token2[] = tokens[2].trim().split(TradingConstants.SPACE_RGX); 
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32 


33 
34 
35 
36 
37 
38 
39 
40 


41 
42 
43 
44 
45 
46 
47 
48 
49 
50 
51 
52 
53 


54 
55 
56 
57 
58 
59 
60 
61 
62 


63 
64 
65 
66 
67 
68 
69 
70 
71 
72 
73 
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return new CloseFXTradeTweet < String > (mew TradeableInstrument < 
String > (this.providerHelper 
. fromIsoFormat(tokensi1sp1[0])), Double. parseDouble(token2[1]), 
Double. parseDouble(tokensisp1[1])); 
} 


@O0verride 
public FXTradeTweet < String > handleTweet(Tweet tweet) { 
String tweetTxt = tweet.getText(); 
String tokens[] = StringUtils.split(tweetTxt, TradingConstants. 
PIPE CHR); 
if (tokens.length >= 5) { 
String action = tokens[1].trim(); 
if (action.startsWith(BUY) || action.startsWith(SELL)) { 
return parseNewTrade(tokens) ; 
} else if (action.startsWith(CLOSE)) { 
return parseCloseTrade(tokens) ; 
} 
i 
return null; 


} 


@Override 
public Collection < Tweet > findHistoricPnlTweetsForInstrument (Tradeab 
leInstrument < String > instrument) { 
/* 
* AND queries for the case below have suddenly stopped working. 
* something simple like from:SignalFactory GBPNZD is not working. 
* Check it out yourself on https://twitter.com/search-advanced. 
* Apparently the only option is to get all tweets with phrase Profit 
* or Loss and then use String contains to perform the step2 
* filtering */ 


String query = String.format("Profit: OR Loss: from:%s", getUserId(), 
isoInstr); 
SearchResults results = twitter.searchOperations().search(query) ; 
List < Tweet > pnlTweets = results.getTweets(); 
List < Tweet > filteredPnlTweets = Lists.newArrayList(); 
for (Tweet pnlTweet: pnlTweets) { 
if (pnlTweet.getText().contains(isoInstr)) { 
filteredPnlTweets.add(pnlTweet) ; 
} 
} 
return filteredPnlTweets; 
i 
} 
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The action starts in the handleTweet (Tweet tweet) method, which is invoked 
as part of parsing the search results for a given user. There is logic to decide whether 
the tweet relates to a new or a close trade or none. This is pretty much the “general 
observation” we made regarding tweets from this user. If the tweet is indeed a 
new or a close trade, we parse and return an instance of the NewFxTradeTweet or 
CloseFxTradeTweet, which are both subclasses of the FXTradeTweet class. The parsing 
logic is pretty much exactly what we discussed in the observations section. 

The last remaining method that needs a bit more explanation is 
findHistoricPnlTweetsForInstrument. Here, we are looking for past close trades tweets. 
Since we are only looking for such tweets by this user, we must use the phrases this user 
uses to denote a profit or a loss. This is precisely what the query from:%s AND %s AND 
Profit: OR Loss: does. Looking back at the examples of close trades from this user, we 
can see that the words “Profit:” or “Loss:” appear as the first word of the third token. 


ZuluTrader101FXTweetHandler 


This tweet handler attempts to parse new/close trade-related tweets published by the 
user @ZuluTrader101. Just to refresh our minds, let’s look at some examples of new and 
close trade tweets by this user in text form: 


1 //New Trade 
2 Bought 0.43 Lots #EURUSD 1.1371 | Auto-copy FREE at http://goo.gl/ 
moaYzx #Forex #Finance #Money 


w 


4 Bought 0.69 Lots #GBPCHF 1.4614 SL 1.45817 TP 1.46617 | Auto-copy FREE 
at http://goo.gl/moaYzx #Forex #Finance #Money 


6 Sold 0.34 Lots #EURUSD 1.13694 | Auto-copy FREE at http://goo.gl/ 
moaYzx #Forex #Finance #Money 


8 Sold 0.43 Lots #EURUSD 1.13117 SL 1.13281 TP 1.12963 | Auto-copy FREE 
at http://goo.gl/moaYzx #Forex #Finance #Money 


10 Bought 0.66 Lots #EURGBP 0.73532 SL 0.70534 | Auto-copy FREE at http:// 
goo.gl/moaYzx #Forex #Finance #Money 


12 //Close Trade 
13 Closed Buy 0.64 Lots #USDJPY 118.773 for +17.7 pips, total for today 


-136.7 pips 

14 

15 Closed Sell 0.69 Lots #NZDUSD 0.75273 for +8.4 pips, total for today 
-1072.8 pips 

16 

17. Closed Buy 7.0 Lots #XAUUSD 1207.94 for -549.0 pips, total for today 
-1731.4 pips 
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For a new trade, we can make the following observations for this user (assuming we 
initially parse the whole tweet by the separator character | and get two tokens): 


e The trade actions always include the words “bought” or “sold,” 
which are the first word of the first token. 


e = The currency pair is always the fourth word starting with # in the 
first token. 


e The price is always the fifth word in the first token. 


e The stop loss price is optional and is only present as the next word 
after the keyword SL in the first token. 


e The take profit price is optional and is only present as the next 
word after the keyword TP in the first token. 


For a close trade, we can make the following observations for this user: 


e The currency pair is always the fifth word starting with # in the 
tweet. 


e The close price is always the sixth word in the tweet. 
e The profit/loss figure is always the eighth word in the tweet. 
A general observation: 
e Atweet relates to a close trade if it starts with the word “closed” 


e =A tweet relates to a new trade if the tweet starts with the words 
“bought” or “sold” 


Now let’s switch our attention to the code implementation: 


ra 


public class ZuluTrader101FXTweetHandler 2 extends 
AbstractFXTweetHandler < String > { 


protected ZuluTrader101FXTweetHandler(String userId) { 
super (userId) ; 


private int idxOfTP(String[] tokens) { 
int idx = 0; 

for (String token: tokens) { 

11 if ("TP".equals(token)) { 

12 return idx; 

13 } 

14 idx++; 

15} 

16 return -1; 

17} 
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19 private int idxOfSL(String[] tokens) { 
20 int idx = 0; 

21 for (String token: tokens) { 

22 if ("SL".equals(token)) { 

23 return idx; 

24 } 

25 idx++; 

26 } 

27 return -1; 

28 «} 

29 

30 © @Override 

31 ~=protected NewFXTradeTweet < String > parseNewTrade(String[] tokens) { 
32 

33 String currencyPair = null; 


34.—isétry { 

35 String ccyWithHashTag = tokens[3]; 

36 currencyPair = this.providerHelper. fromHashTagCurrency(ccyWithHash 
Tag); 


37 double price = Double.parseDouble(tokens[4]); 
38 TradingSignal signal = BOUGHT.equals(tokens[0]) ? TradingSignal.LONG : 
39 TradingSignal . SHORT; 
40 double stopLoss = 0.0; 
41 double takeProfit = 0.0; 
42 int idxTp = idxOfTP(tokens); 
43 if (idxTp != -1) { 
AA takeProfit = Double.parseDouble(tokens[idxTp + 1]); 
45 } 
46 int idxSl = idxOfSL(tokens); 
! 


47 if (idxSl != -1) { 

48 stopLoss = Double.parseDouble(tokens[idxSl + 1]); 

49 } 

50 return new NewFXTradeTweet < String > (mew TradeableInstrument < 
String > (currencyPair), price, stopLoss, 

51 takeProfit, signal); 


52 } catch (Exception e) { 

53 LOG. info( 

54 String. format(" got err %s parsing tweet tokens for new trade ", 
55 e.getMessage())); 

56 return null; 

57S 

58 

59} 

60 

61 @Override 
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protected CloseFXTradeTweet < String > parseCloseTrade(String|[ ] 
tokens) { 


String currencyPair = null; 
try { 
String ccyWithHashTag = tokens[4]; 
currencyPair = this.providerHelper. fromHashTagCurrency(ccyWithHash 
Tag); 
String strPnlPips = tokens[7]; 
return new CloseFXTradeTweet < String > (mew TradeableInstrument < 
String > (currencyPair), Double 
-parseDouble(strPnlPips), Double.parseDouble(tokens[5])); 
} catch (Exception e) { 
LOG. info( 
String. format(" got err %s parsing tweet tokens for close trade:", 
e.getMessage())); 
return null; 


} 
} 


@O0verride 
public FXTradeTweet < String > handleTweet(Tweet tweet) { 
String tweetTxt = tweet.getText(); 
String tokens[] = tweetTxt.trim().split(TradingConstants.SPACE_RGX) ; 
if (tweetTxt.startsWith(CLOSED)) { 
return parseCloseTrade(tokens); 
} else if (tweetTxt.startsWith(BOUGHT) || tweetTxt.startsWith(SOLD) ) 
{ 
return parseNewTrade(tokens) ; 
} 
return null; 


} 


@Override 
public Collection < Tweet > 
findHistoricPnlTweetsForInstrument(TradeableInstrument < String > 
instrument) { 
String isoInstr = TradingConstants.HASHTAG + 
this. providerHelper.toIsoFormat (instrument.getInstrument()); 
SearchResults results = twitter.searchOperations().search( 
String. format("from:%s AND %s AND \"Closed Buy\" OR \"Closed 
Sell\"", 
getUserId(), isoInstr)); 
return results.getTweets(); 


: 
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As before, the action starts in the handleTweet (Tweet tweet) method. This time 
around, we have a slightly different logic, based on the general observation regarding 
which tweet is a new or close trade or is not parsable. Assuming that it is either a new or a 
close trade, we proceed to parse the tweet. The parsing follows the same logic mentioned 
in the observations section. 

The very last thing remaining to discuss is the method 
findHistoricPnlTweetsForInstrument for this user. Just as for the user @SignalFactory 
we need to find the phrases used by this user to denote closed trades. It turns out that 
this user, @ZuluTrader101, from our observations about closed trades, uses the phrases 
“closed buy” or “closed sell” Hence, our query looks like from:%s AND %s AND “Closed 
Buy” OR “Closed Sell”. Just a remark before we go, about the Twitter search API. If we 
double-quote a phrase, it means we are looking for an exact match of that phrase. And 
this is what we want for this user. 


Try It Yourself 


In this section we are going to write a demo program that harvests tweets from a given 
user. Recent tests show that a very simple tweet search from user @ZuluTrader101 do not 
show up, even on the Twitter advanced search page. We are going to use the @Forex_EA4U 
" user, who tweets in very similar format. 


1 package com.precioustech. fxtrading. tradingbot.social.twitter. 
tweethandler ; 


import java.util.Collection; 
import java.util. Iterator; 


import org.apache.log4j.Logger; 

import org.springframework.context.ApplicationContext ; 
import org.springframework. context. support. 
ClassPathXmlApplicationContext ; 


CON DU BPWN 


10 import com.precioustech. fxtrading. instrument. TradeableInstrument ; 

11 import com.precioustech.fxtrading.tradingbot.social.twitter. 
CloseFXTradeTweet ; 

12 import com.precioustech.fxtrading.tradingbot.social.twitter. 
NewFXTradeTweet ; 


14 public class TweetHarvesterDemo { 
15 private static final Logger LOG = Logger.getLogger(TweetHarvesterDemo. 
class); 


17 @SuppressWarnings ("unchecked") 
18 public static void main(String[] args) { 


"https: //twitter.com/Forex_EA4U 
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19 

20 ApplicationContext appContext = 

21 new ClassPathXmlApplicationContext ("tweetharvester-demo. xml") ; 

22 TweetHarvester < String > tweetHarvester = appContext. 
getBean(TweetHarvester.class); 

23 

24 TradeableInstrument < String > eurusd = new TradeableInstrument 


< String > ("EUR_USD"); 
25 String userId = "Forex_EA4U"; 
26 // String userId = "SignalFactory"; 


27 final int tweetsToDump = 10; 

28 int ctr = 0; 

29 

30 Collection < NewFXTradeTweet < String >> newTradeTweets = 

31 tweetHarvester.harvestNewTradeTweets (userId) ; 

32 LOG. info( 

33 String. format("+++++++++ Dumping the first %d of %d new fx tweets 
for userid %s +++++++", 

34 tweetsToDump, newTradeTweets.size(), userId)); 

35 Iterator < NewFXTradeTweet < String >> newlweetItr = newlradeTweets. 
iterator(); 

36 while (newTweetItr.hasNext() && ctr < tweetsToDump) { 

37 NewFXTradeTweet < String > newFxTweet = newTweetItr.next(); 

38 LOG. info(newFxTweet) ; 

39 ctr++; 

40 } 

41 

42 Collection < CloseFXTradeTweet < String >> closedTradeTweets = 

43 tweetHarvester.harvestHistoricTradeTweets(userId, eurusd); 


44 ctr = 0; 

45 Iterator < CloseFXTradeTweet < String >> closedTweetItr = 
closedTradeTweets.iterator(); 

46 LOG. info( 


47 String. format("+++++++++ Dumping the first %d of %d closed fx tweets 
for userid %s +++++++", 

48 tweetsToDump, closedTradeTweets.size(), userId)); 

49 while (closedTweetItr.hasNext() && ctr < tweetsToDump) { 

50 CloseFXTradeTweet < String > closeFxTweet = closedTweetItr.next(); 

51 LOG. info( 

52 String. format("Instrument %s, profit = %3.1f, price=%2.5f ", 

53 closeFxTweet.getInstrument().getInstrument(), | closeFxTweet. 

getProfit(), 

54 closeFxTweet.getPrice())); 

55 ctr++; 

56 } 

57 

58} 

59 

60 } 


CHAPTER 8 — INTEGRATION WITH TWITTER 


This is a Spring-driven demo, because we want to use the TwitterTemplate 
discussed earlier. The Spring configuration looks like this: 


1 <?xml version="1.0" encoding="UTF-8"?> 

2 <beans xmlns="http://www. springframework.org/schema/beans" 

3 xmlns:xsi="http: //www.w3.org/2001/XMLSchema-instance" 

4 xmlns:context="http://www. springframework.org/schema/context" 

5 xmlns:util="http://www. springframework.org/schema/util" 

6 xmlns:task="http: //www. springframework.org/schema/task" 

7 xmlns:tx="http://www. springframework.org/schema/tx" 

8 xsi:schemaLocation="http: //www. springframework.org/schema/beans 
9 http://www. springframework.org/schema/beans/spring-beans.xsd 


10 http://www. springframework.org/schema/context 

11 http://www. springframework.org/schema/context/spring-context.xsd 

12 http://www. springframework.org/schema/util 

13 http://www. springframework.org/schema/util/spring-util.xsd"> 

14 <context: annotation-config/> 

15 <bean id="twitter" class="org.springframework.social.twitter.api. 

imp1.TwitterTemplate"> 

16 <constructor-arg index="0" value="#{ 
systemProperties[ 'twitter.consumerKey'] }"/> 

17 <constructor-arg index="1" value="#{ 
systemProperties[ 'twitter.consumerSecret'] }"/> 

18 <constructor-arg index="2" value="#{ 
systemProperties[ 'twitter.accessToken'] }"/> 

19 <constructor-arg index="3" value="#{ 
systemProperties| 'twitter.accessTokenSecret'] }"/> 

20 </bean> 

21 <bean id="providerHelper" class="com.precioustech. fxtrading. 

oanda.restapi.helper.OandaProviderHelper"/> 

22 <bean id="instrumentDataProvider" 

23 class="com.precioustech. fxtrading.oanda.restapi. 
instrument .OandaInstrumentDataProviderService"> 

24 <constructor-arg index="0" value="#{ 
systemProperties['oanda.url'] }"/> 

25 <constructor-arg index="1" value="#{ 
systemProperties['oanda.accountId'] }"/> 

26 <constructor-arg index="2" value="#{ 


systemProperties['oanda.accessToken'] }"/> 
27 </bean> 


28 <bean id="instrumentService" class="com.precioustech. fxtrading. 
instrument. InstrumentService"> 

29 <constructor-arg index="0" ref="instrumentDataProvider"/> 

30 </bean> 
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</beans> 
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<bean id="fxTweeterList" class="java.util.ArrayList"> 
<constructor-arg index="0"> 
<list> 
<value>SignalFactory</walue> 
<value>Forex_EA4U</value> 
</list> 
</constructor-arg> 
</bean> 
<bean id="startTimeLine" class="org.joda.time.DateTime"> 
<constructor-arg index="0" value="1451606400000" 
type="long"/><!-- 01 Jan 2016 --> 
</bean> 
<utilsmap id="tweetHandlerMap"> 
<entry key="#{fxTweeterList[0]}"> 
<bean 
class="com. precioustech. fxtrading.tradingbot.social.twitter. 
tweethandler.SignalFactoryFXTweetHandler"> 
<constructor-arg index="0" value="#{ 
fxTweeterList[0]}"/> 
<property name="startTime" ref="startTimeLine"/> 
</bean> 
</entry> 
<entry key="#{fxTweeterList[1]}"> 
<bean 
class="com.precioustech. fxtrading.tradingbot.social.twitter. 
tweethandler.ZuluTrader101FXTweetHandler"> 
<constructor-arg index="0" value="#{fxTweeterLi 
st[1]}"/> 
<property name="startTime" ref="startTimeLine"/> 
</bean> 
</entry> 
</util:map> 
<bean id="orderQueue" class="java.util.concurrent. 
LinkedBlockingQueue"/> 
<bean id="copyTwitterStrategy" 
class="com.precioustech. fxtrading.tradingbot.strategies. 
CopyTwitterStrategy"/> 
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Name: TweetHarvesterDemo 


© main ee Arguments)». = JRE &%; Classpatn| 8» Source |B Environment [7] Common 
reer = Bachem bal oo 


) 
/ 
| 


Variables... 


VM arguments: 


-Dtwitter.consumerKey = aaepnhentheleiaiieeatieget KR - 

Dtw tter CONSUMCISCCrCt -taemia—nndiiienpiatiaitintinniinpiatatiintiitinbammmmintinanibiined 201% -OtwitteraccessToken = tidiipaipiadita 
SE EEE 
Ooanda.url=https://api-fxtrade.oanda.com - 

000700, OCC OSS TOKCN - SORTS A SSRIS 5 00995) OCCOUNt|C ~ Mana 


Variables 


© Use the -XstartOnFirstThread argument when launching with SWT 


Working directory: 
© Detauit: 
~) Other: 


cone) 
Figure 8-11. Launch configuration with system properties 


<terrrinated> TaretharwesterDemo Liava Application) (A Ibrarpleva/ lavaVrtuaMachines/jck 1 7.0.71 jik/CorsencsMome/birjjava (28 Jan 2016 12:10.55) 
POL6-01-28 12:10:56,030 INFO [moin) - Refreshing org. springfromesork.context. support .ClossPathkwlapplicetionComtect@SedScdc: stortup date (Thw Jom 28 12:10:56 CET 2816); 


INFO (mein) 
2016 28 12:11:04,800 INFO (mein) 
2016-12-28 12:11:04,802 INFO (mein) 
2016-01-28 12:11:07,265 INFO [mein] 
INFO (mein) 


INFO [moin} - Looding IML bean definitions from closs poth resource [tweethorvester-demo. onl] 
56,997 INFO [moin] - JSR-338 *jovox.inject Inject" annotation found ond supported for cutowiring 
$8,365 INFO [moin} - Executing request : GET https://api-fxtrade.cande, com/vi/imstruments?account Iq Methbehf ields=instrument&2Cpipk2CinterestRate HITP/t.+ 
204,708 INFO [moin} ~ Found 5B new tweets for user Forex FAAU 
204,795 INFO [moin) ~ seseseeee Dumping the First 10 of 23 mew fx tweets for userid Forex Ad ssseres 
204,799 INFO (mein) 2 SL: @. 00000 SHORT 
204,799 INFO [mein] ~ st 
04,799 INFO [moin) - oe 
04,800 INFO (mein) - Sh 
04,800 INFO (mein) - 2 Sh 
204,820 INFO [motn) Sh 
04,820 INFO (mein) s 
ete 
si 


t Shs 0.00880 LOWS 
found S@ historic pnl tweets for user Forex LAGU ond instrument (UR_USO 
seeeeeeee Dumping the First 38 of SB closed fx tweets For weerid ForexEMAl sreenes 


INFO [mein) - Instrument GURUSO, profit = 3.6, price-1.09287 

INFO (mein) ~ Instrument EUR_USO, profit ~ 3. price-1.07044 

INFO [moin} - Instrument EURUSO, profit = 3.0, price-1.08778 

INFO [moin) ~ Instrument EUR_USO, profit ~ 3.0, price-1.08768 

FO [moin} - Instrument EURWSO, profit ~ 3.0, price-1.08769 

INFO [moin} - Instrument EURUSO, profit = 3.0, price=1.088S7 

INFO [moin} - Instrument fu profit = 3.0, prices1.08e75 

2016-81-28 12:11:07,325 INFO [ecin] - Instrument profit = 3.0, pricest.ORen6 
2016-01-28 12:11:07,325 INFO [ecin) ~ Instrument profit = 3.0, pricest 03936 
2016-81-28 12:11:07,326 INFO [moin} - Instrument EURUSD, profit ~ 3.0, prices1.03014 


Figure 8-12. Sample output 
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Implementing Strategies 


It is now time to give our bot wings and make it fly!! Well, what I mean is that the time 
has come to add capabilities to our bot so that it can make decisions in terms of placing 
orders based on a certain set of rules that we know is a strategy. Basically, we want to add 
the power of analysis to our bot to determine whether to buy or sell a currency pair or 

to stay put and wait for the right moment. The analysis can be based on several external 
parameters, including: 


e = Market data 
e = News events 
e Social media feeds 
e —_ Technical analysis 


° Sentiment 


A strategy can be based solely on technical analysis of prices over a period of time 
and on the other hand can be based on realtime analysis of all or a mixture of these 
parameters. For example, a complex strategy could be built on realtime analysis of 
social media feeds to ascertain the sentiment index (a hypothetical index based on how 
much positivity surrounds us) and market data to arrive at a trading decision. It can 
be as simple as single dimensional analysis to as complex as multivariate analysis. The 
possibilities are infinite! 

In this chapter, we try to implement a couple of strategies, one of them based 
on Twitter feed analysis and the other a more popular one, used often by traders. We 
will program these strategies and integrate them into our trading bot in order to build 
capabilities to produce a trading signal, and as a result, place orders. 

Before we dive into these strategies, I want to take this opportunity to discuss briefly 
the design of how the various strategies generate a TradingDecision that’s placed in the 
queue. The OrderExecutionService then picks these TradingDecision messages 
(see Figure 9-1). Chapter 6 covers how these messages are handled. 
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OrderExecutionService 
A 


! 
| 
| TradingDecision Queue 


A A A 
I 


! \ 
I i 


Strategy1 Strategy2 StrategyN 


Figure 9-1. Trading signal generation 


Disclaimer The strategies discussed in this chapter are purely for discussion and 
demonstration purposes. Developers must use their own reasoning/judgment before 
applying them in a live trading environment. In no event is the author liable for any 
direct, indirect, incidental, special, exemplary, or consequential damages arising from the 
deployment of the strategies discussed. 


Copy Twitter Strategy 


This strategy is aimed at blindly copying or doing the exact opposite of what the Twitter 
user has just tweeted. It works as follows: 


e Using the tools and knowledge we developed in the last chapter, 
we follow a set of users on Twitter who often tweet new trade and 
close trade messages. We use a predefined structure, something 
that a handler can parse and use to create a NewFxTradeTweet or 
CloseFxTradeTweet object. We studied and analyzed the tweets of 
two such users—@SignalFactory and @ZuluTrader101. 


e Wecreate a scheduled job that searches for new tweets from these 
users. When a new trade tweet is found and successfully parsed into a 
NewFxTradeTweet object, we search historic tweets by the same user 
and for the instrument for which he just tweeted to go long or short. 


204 


CHAPTER 9 — IMPLEMENTING STRATEGIES 


e We parse the collection of historic tweets to create a collection 
of CloseFxTradeTweet objects. Each CloseFxTradeTweet, as we 
know, has an attribute that holds a profit/loss figure. If we cannot 
find one, it defaults to 0.0. 


e We analyze how many previous trades were profitable and how 
many were loss, making the total. 


e Ifthe analysis tells us that the user recommendation for this trade 
in the past was more than 75% accurate, we do exactly what he 
has suggested in the recent trade. If, on the contrary, it suggests 
that he/she was wrong more than 75% of the time, we do exactly 
the opposite. For any other condition, we take no further decision 
and ignore the tweet. We also need to make sure that we are 
analyzing at least four historic tweets in order to give us better 
accuracy. 


The figure of 75% and picking four tweets is arbitrary and can vary from one 
installation to another. Let’s look at the code that tries to implement this strategy. 


1 @TradingStrategy 


2 public class CopyTwitterStrategy < T > implements TweetHarvester 
<Tof 

3 

4 @Resource 

5 Map < String, 

6 FXTweetHandler < T >> tweetHandlerMap; 

7 @Resource(name = "orderQueue") 

8 BlockingQueue < TradingDecision < T >> orderQueue; 

9 private static final Logger LOG = Logger. 


getLogger (CopyTwitterStrategy.class) ; 
10 private ExecutorService executorService = null; 
11 private static final double ACCURACY DESIRED = 0.75; 
12 private static final int MIN HISTORIC_TWEETS = 4; 
13 
14 @PostConstruct 
15 public void init() { 


16 this.executorService = Executors.newFixedThreadPool(tweetHandlerMap. 
size()); 

17} 

18 


19 TradingDecision < T > 

20 analyseHistoricClosedTradesForInstrument (Collection < 
CloseFXTradeTweet < T >> 

21 closedTrades, NewFXTradeTweet < T > newTrade) { 

22 int lossCtr = 0; 

23 int profitCtr = 0; 
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for (CloseFXTradeTweet < T > closedTrade: closedTrades) { 
if (closedTrade.getProfit() <= 0) { 
lossCtr++; 
} else { 
profitCtr++; 
} 


} 
TradingSignal signal = TradingSignal.NONE; 


if ((lossCtr != 0 || profitCtr != 0) && closedTrades.size() >= 
MIN HISTORIC_TWEETS) { 
double profitAccuracy = profitCtr / ((profitCtr + lossCtr) * 1.0); 
double lossAccuracy = 1.0 - profitAccuracy; 
if (profitAccuracy >= ACCURACY DESIRED) { 
signal = newTrade.getAction(); 
return new TradingDecision < T > (newTrade.getInstrument(), signal, 
newTrade.getTakeProfit(), newlrade.getStopLoss(), 
newTrade.getPrice(), TradingDecision.SRCDECISION.SOCIAL MEDIA) ; 
} else if (lossAccuracy >= ACCURACY DESIRED) { 
/*execute an opposite trade as the loss accuracy is quite high*/ 
signal = newTrade.getAction().flip(); 
final double takeProfit = newTrade.getTakeProfit() != 0 ? 
newTrade.getPrice() + 
(newTrade.getPrice() - newlrade.getTakeProfit()) : 
newTrade. getTakeProfit(); 
final double stopLoss = newTrade.getStopLoss() != 0.0 ? 
newTrade.getPrice() + 
(newTrade.getPrice() - newTlrade.getStopLoss()) : 
newTrade.getStopLoss(); 
return new TradingDecision < T > (newTrade.getInstrument(), 
signal, takeProfit, stopLoss, newlrade.getPrice(), 
TradingDecision.SRCDECISION.SOCIAL MEDIA) ; 
} 
return new TradingDecision < T > (newTrade.getInstrument(), signal); 


} 


// called by scheduler 

public synchronized void harvestAndTrade() { 

for (final String userId: tweetHandlerMap.keySet()) { 
this.executorService.submit(mew Callable < Void > () { 


@O0verride 

public Void call() throws Exception { 

Collection < NewFXTradeTweet < T >> newlradeTweets = 
harvestNewTradeTweets (userId); 
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for (NewFXTradeTweet < T > newTradeTweet: newTradeTweets) { 

Collection < CloseFXTradeTweet < T >> pnlTweets = 
harvestHistoricTradeTweets(userId, newTradeTweet. 
getInstrument()); 

TradingDecision < T > tradeDecision = 
analyseHistoricClosedTradesForInstrument(pnlTweets, 
newTradeTweet) ; 

if (tradeDecision.getSignal() != TradingSignal.NONE) { 
orderQueue. offer (tradeDecision) ; 

} 
return null; 
} 
})5 
} 
} 


@Override 
public Collection < NewFXTradeTweet < T >> 
harvestNewlradeTweets(String userId) { 
FXTweetHandler < T > tweetHandler = tweetHandlerMap.get (userId) ; 
if (tweetHandler == null) { 
return Collections.emptyList(); 
} 
Collection < Tweet > tweets = tweetHandler.findNewTweets(); 
if (tweets.size() > 0) { 
LOG. info(String. format ( 
"found %d new tweets for user %s", tweets.size(), userId)); 
} else { 
return Collections.emptyList(); 


} 


Collection < NewFXTradeTweet < T >> newTradeTweets = Lists. 
newArrayList(); 
for (Tweet tweet: tweets) { 
FXTradeTweet < T > tradeTweet = tweetHandler.handleTweet (tweet) ; 
if (tradeTweet instanceof NewFXTradeTweet) { 
newTradeTweets.add((NewFXTradeTweet < T > ) tradeTweet); 
} 
} 


return newlradeTweets; 


} 
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108 @Override 

109 public Collection < CloseFXTradeTweet < T >> 
harvestHistoricTradeTweets ( 

110 String userId, TradeableInstrument < T > instrument) { 

111 FXTweetHandler < T > tweetHandler = tweetHandlerMap.get (userId) ; 

112 if (tweetHandler == null) { 


113 return Collections.emptyList(); 

114 } 

115 Collection < Tweet > tweets = 

116 tweetHandler. findHistoricPnlTweetsForInstrument (instrument) ; 


117 if (tweets.size() > 0) { 
118 LOG. info(String. format ( 


119 "found %d historic pnl tweets for user %s and instrument %s", 

120 tweets.size(), userId, instrument.getInstrument())); 

121 } else { 

122 return Collections.emptyList(); 

123 } 

124 Collection < CloseFXTradeTweet < T >> pnlTradeTweets = Lists. 
newArrayList(); 

125 for (Tweet tweet: tweets) { 

126 FXTradeTweet < T > tradeTweet = tweetHandler.handleTweet (tweet) ; 

127 if (tradeTweet instanceof CloseFXTradeTweet) { 

128 pnlTradeTweets.add((CloseFXTradeTweet < T > ) tradeTweet); 

129 } 

130 } 

131 return pnlTradeTweets; 

132 } 

133} 


We begin by annotating the class with a custom annotation @TradingStrategy. By 
doing so, we are making a statement about this class, which is that this class explicitly 
implements a trading strategy. It is always a good idea to do this when certain classes 
are specifically written to accomplish a task but cannot be tied down to an interface 
definition. Pre Java 1.5, you could achieve the same effect by declaring marker interfaces. 


@Retention(RetentionPolicy.RUNTIME) 
@Target (ElementType. TYPE) 
public @interface TradingStrategy { 


} 


BWNP 


Going back to our strategy class CopyTwitterStrategy, before we discuss the 
implementation, we point out the resources that are automatically injected by Spring and 
are available. These are as follows: 


e orderQueuve: The queue on which you can drop a 
TradingDecision, which will be picked up by the 
OrderExecutionService (refer back to Figure 9-1). 
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e tweetHandlerMap: The map of Twitter user IDs and the respective 
handlers, which we discussed in great detail in the last chapter. 
We use this as a starting point to find all tweets by user IDs in the 
map and then delegate to the respective handler to analyze them. 


The init() method annotated by @PostConstruct is invoked automatically by 
Spring once the bean is fully initialized. Here we take the opportunity to initialize our 
ExecutorService, which we will come back to shortly. 

All the action for this class starts in the method harvestAndTrade( ). This method, 
as will be discussed in the following chapter, is automatically called by the Spring task 
scheduler after every T and is configured in the Spring configuration. This method is 
synchronized in order to make sure that we do not have more than one thread executing 
the method. As the name suggests, it harvests tweets for each user and generates a 
trading decision. Inside the method, we loop for all entries in the tweetHandlerMap and 
submit a Callable to the ExecutorService. This Callable has the following logic in the 
call() method for the given user: 


e _ Find all tweets that relate to new trades and are successfully 
parsed to create a collection of NewFXTradeTweet objects. (Refer 
to Chapter 8, where we discuss the search API to find these tweets 
and parse them.) 


e For each of the NewFXTradeTweet objects, harvest tweets relating 
to closed trades only for the given instrument. 


e Delegate the analysis of these tweets to the 
analyseHistoricClosedTradesForInstrument method, which 
does the accuracy rate computation for the user and generates a 
TradingDecision. Recall that the accuracy rate is the percentage 
of time the user was correct in their previous trades. This is the 
gist of our strategy discussed earlier in the section. 


The analyseHistoricClosedTradesForInstrument method merits a bit of 
explanation. At the beginning of the method we compute the accuracy rate. For this 
we first get a count of all trades that are loss making or in profit by looping through the 
collection of old closed trades. The closedTrade.getProfit() method helps us in this 
respect. We then go further only if the number of closed trades is greater than or equal to 
the minimum threshold, in this case four. Assuming 


e P=Number of profit-making trades 

e L=Number of loss-making trades 

e N= Total number of closed trades found 
such that P + L=N, then: 

e = Accuracy rate R= P/N 

e © MissrateM=1-R 
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So if R is greater than or equal to the threshold for the desired accuracy, in this 
case 0.75, we do exactly what the user tweeted. For example, if the user recommends 
selling a currency pair at a given price, we do exactly that. On the other hand, if Mis 
greater than or equal to the threshold, we do exactly the opposite. So for example, if the 
user recommends selling a currency pair, we buy the currency pair at the given price. The 
calculation of stop loss and take profit levels needs readjusting. Since the user initially 
recommended selling the currency pair and would have set a take profit at level pips P 
below the price, we now need to turn it around and make it at a distance of pips P above 
the price. The same logic applies to the stop loss levels. 

This concludes our discussion of the copy Twitter strategy. The crux of the strategy, 
which is the accuracy rate calculation, is based on a very simplistic mathematical 
calculation. Many would argue that it’s too simple and circumvents the statistical analysis 
that might be required to arrive at a more accurate decision. This may be very true but 
again I would like to reiterate that it’s for demonstration purposes only. The key aim of the 
chapter was to demonstrate: 


e = Integrate with Twitter and analyze tweets. 


e Use simplistic code/algorithm to do some mathematical analysis 
of the tweets and arrive at a trading signal. 


e¢ Queue this signal in the order queue to be processed further by 
OrderExecutionService, which ultimately has the responsibility 
of placing the order. 


Fade the Move Strategy 


In this section, we are going to discuss and implement a very simplistic version of the fade 
the move' strategy. Our implementation of the strategy works as follows: 


e = After the strategy is initialized, we create a subscription for tick 
data for predefined instruments injected via the configuration. 


e After every period of time T, let’s say 15 minutes (the value in the 
current configuration), we check if the the absolute value of the 
difference of pips between the price at the start of interval and at 
the end of the period has exceeded a configured value V pips, let’s 
say 45 (the value in the current configuration). 


e Ifthe value has exceeded V pips, we then place a limit order in 
the opposite direction of current market trend, at a distance D 
pips, let’s say 25 (the value in the current configuration), from 
the current price. For example, if EURUSD has jumped by 55 pips 
from 1.0815 (start price) to 1.087 (current price) in the last 15 
minutes, we place a limit order to sell EURUSD at price 1.0895 
(1.087+0.0025). 


‘http://www. investopedia.com/articles/forex/08/pure-fade-trade.asp 
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e Weseta take profit target of 10 pips (take profit at 1.0885 if limit 
order filled at 1.0895). 


Now let’s jump directly to the source code to see how the strategy is implemented. 


@TradingStrategy 
public class FadeTheMoveStrategy < T > { 


1 

2 

3 

4 @Autowired 

5 TradingConfig tradingConfig; 

6 @Autowired 

7 InstrumentService < T > instrumentService; 

8 @Resource(name = "orderQueue" ) 

9 BlockingQueue < TradingDecision < T >> orderQueue; 

0 private final Collection < TradeableInstrument < T >> instruments; 


12 private final Map < TradeableInstrument < T > , 

13 Cache < DateTime, 

14 MarketDataPayLoad < T >>> instrumentRecentPricesCache = Maps 
15 -newHashMap(); 


17 public FadeTheMoveStrategy(Collection < TradeableInstrument < T >> 
instruments) { 

18 this.instruments = instruments; 

19 } 


21 @PostConstruct 
22 public void init() { 


23 for (TradeableInstrument < T > instrument: instruments) { 

24 Cache < DateTime, MarketDataPayLoad < T >> recentPricesCache = 
25 CacheBuilder.newBuilder().expireAfterwWrite( 

26 tradingConfig.getFadeTheMovePriceExpiry(), TimeUnit.MINUTES) 
27 : < DateTime, MarketDataPayLoad < T >> build(); 

28 instrumentRecentPricesCache.put(instrument, recentPricesCache) ; 
29 } 

30 SW 

31 


32 @Subscribe 

33 @AllowConcurrentEvents 

34 public void handleMarketDataEvent (MarketDataPayLoad < T > 
marketDataPayLoad) { 


35 if (instrumentRecentPricesCache.containsKey ( 

36 marketDataPayLoad.getInstrument())) { 

37 instrumentRecentPricesCache. get (marketDataPayLoad.getInstrument() ) 
38 .put(marketDataPayLoad.getEventDate(), marketDataPayLoad) ; 

39 } 

40 } 

41 
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// called by scheduler 

public void analysePrices() { 

for (Map.Entry < TradeableInstrument < T > , Cache < DateTime, 
MarketDataPayLoad < T >>> entry: instrumentRecentPricesCache. 
entrySet()) { 


Ss 


ortedMap < DateTime, MarketDataPayLoad < T >> sortedByDate = 
ImmutableSortedMap. copyOf(entry.getValue().asMap()); 


if (sortedByDate.isEmpty()) { 


} 


continue; 


Double pipJump = calculatePipJump(sortedByDate.values(), entry. 
getKey()); 

Double absPipJump = Math.abs(pipJump); 

if (absPipJump >= tradingConfig.getFadeTheMoveJumpReqdToTrade()) { 


MarketDataPayLoad < T > lastPayLoad = 
sortedByDate. get (sortedByDate. lastKey()); 
Double pip = this. instrumentService.getPipForInstrument (entry. 
getkey()); 
double takeProfitPrice; 
double limitPrice; 
TradingSignal signal = null; 
if (Math.signum(pipJump) > 0) { // Short 
signal = TradingSignal. SHORT; 
limitPrice = lastPayLoad.getBidPrice() + 
tradingConfig.getFadeTheMoveDistanceToTrade() * pip; 
takeProfitPrice = limitPrice - 
tradingConfig.getFadeTheMovePipsDesired() * pip; 
} else { 
signal = TradingSignal.LONG; 
limitPrice = lastPayLoad.getAskPrice() - 
tradingConfig.getFadeTheMoveDistanceToTrade() * pip; 
takeProfitPrice = limitPrice + 
tradingConfig.getFadeTheMovePipsDesired() * pip; 
} 
this .orderQueue.offer(new TradingDecision < T > (entry.getKey(), 
signal, 
takeProfitPrice, 0.0, limitPrice, 
TradingDecision.SRCDECISION. FADE THE MOVE)); 
entry.getValue().asMap().clear(); 
/*clear the prices so that we do not keep working on old decision*/ 
} 
} 
} 
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82 private double calculatePipJump(Collection < MarketDataPayLoad < T >> 


prices, 
83 TradeableInstrument < T > instrument) { 
84 List < MarketDataPayLoad < T >> priceList = Lists. 
newArrayList (prices) ; 
85 MarketDataPayLoad < T > startPrice = priceList.get(0); 
86 MarketDataPayLoad < T > lastPrice = priceList.get(priceList.size() 
21); 
87 Double pip = this.instrumentService.getPipForInstrument (instrument) ; 
88 Double pipJump = (lastPrice.getBidPrice() - startPrice. 
getBidPrice()) / pip; 
89 return pipJump; 
90 } 
91 } 


We start our discussion by looking at the dependencies autowired into the strategy 
class. The resource orderQueue is the obvious inclusion that we discussed in the 
beginning of the chapter. The instrumentService class in the strategy is called upon to 
provide a pip value for each instrument. The pip, from our discussion in Chapter 3, is 
the lower precision value for a price tick. For example, for all JPY pairs (with majors), it 
is 0.001 and for instruments like EURUSD, GBPUSD it is 0.00001. We need this information 
to calculate how many pips the price has jumped in the given observation interval. 
This is pretty much also captured in the calculatePipJump method. The last price of 
the observation interval minus the first price and the result divided by this pip value for 
the instrument gives us the pips, how much the currency pair rose or dipped. The last 
dependency injected, tradingConfig, gives us the parameters that we have configured in 
the Spring config, for our strategy: 


e The minimum pip jump or dip required to consider 
fading the move is stored in the method getfade- 
TheMoveJumpReqdToTrade(). 


e The distance in pips from the current price the limit order should 
be placed in the opposite direction of the trend is stored in the 
method getFadeTheMoveDistanceToTrade(). 


e The session length for observation interval in minutes is stored in 
the method getFadeTheMovePrice- Expiry(). 


e The profit desired in pips, which helps set the take 
profit price for the limit order, is stored in the method 
getFadeTheMovePipsDesired(). 


The constructor of the class accepts a list of instruments that we must apply this 
strategy to and is a constructor injected by Spring. 

We also have a @PostConstruct annotated method init() where we initialize a 
guava’ cache for each instrument injected. The cache is keyed by DateTime of the tick data 


*https://github.com/google/guava/wiki/CachesExplained 
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event and the value is the MarketDataPayLoad. We also set the expireAfterWrite value T 
provided by tradingConfig.getFadeTheMovePriceExpiry() to automatically expire the 
entries from the cache after T minutes. 

The handleMarketDataEvent() method is annotated by the @Subscribe 
annotation, which means it receives all tick data events that have been parsed into 
the MarketDataPayLoad object and disseminated by the EventBus. Once received, the 
instance of MarketDataPayload is accepted only if it relates to the instrument that we 
configured the cache for and then put in the cache for that instrument. 

The main action in the strategy happens in the method analysePrices(). 

This method is called by the task scheduler after every T minutes, the value of which 

is configured in the Spring configuration. This should normally be the same as 
tradingConfig.getFadeTheMovePriceExpiry(). We start by looping through all 
instruments configured in the cache. For each of them, we calculate the pip jump in 
absolute value in the given time period. If the pip jump is not above the minimum 
threshold (> get fadeTheMoveJumpReqdToTrade( )), we ignore this. If the pip jump is above 
this threshold, we try to ascertain the market trend by looking at the sign of the pip jump. 
If its negative, we know that the trend is downward; otherwise, it’s upward. For an upward 
trend, we place a SHORT trade or use LONG for a downward trend. We then calculate the 
limit price of the order using tradingConfig.getFadeTheMoveDistanceToTrade() and 
the take profit price using tradingConfig.getFadeTheMovePipsDesired(). 

This concludes our discussion of this strategy. It is a well known strategy and seems 
to work. Don’t use a large number for the take profit pips. It seems to work most of the 
time if this value is around 10-12 pips. That seems to be the general observation of many 
market participants. 


Try It Yourself 


In this section, we are going to write a Spring-driven program that test drives 
FadeTheMoveStrategy. We will use an array of prices to simulate increasing prices for 
the currency pair AUD_CHF over a period of a few minutes. When the analysePrices() 
is invoked, the jump in prices should result in a SHORT signal being generated on the 
orderQueue. Let’s look at the code and the Spring configuration: 


1 package com.precioustech. fxtrading. tradingbot.strategies ; 

2 

3 import java.util.concurrent.BlockingQueue ; 

4 

5 import org. joda.time.DateTime; 

6 import org.springframework.context.ApplicationContext ; 

7 import org.springframework.context.support. 
ClassPathXmlApplicationContext ; 

8 


9 import com.google.common.eventbus.EventBus ; 
10 import com.precioustech.fxtrading.TradingDecision; 
11 import com.precioustech.fxtrading. instrument. TradeableInstrument ; 
12 import com.precioustech.fxtrading.marketdata.MarketDataPayLoad ; 
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public class FadeTheMoveStrategyDemo { 


private static double precision 


@SuppressWarnings ("unchecked") 


= 0.0001; 


public static void main(String[] args) throws InterruptedException { 


ApplicationContext appContext = 


new ClassPathXmlApplicationContext ("fadethemove-demo. xml") ; 
FadeTheMoveStrategy < String > fadeTheMoveStrategy = appContext. 
getBean(FadeTheMoveStrategy.class); 

BlockingQueue < TradingDecision < String >> orderQueue = 
appContext.getBean(BlockingQueue. class) ; 

EventBus eventBus = new EventBus(); 

eventBus. register (fadeTheMoveStrategy) ; 


TradeableInstrument < String > audchf = new TradeableInstrument 


< String > ("AUD CHF"); 
final double] audchfPrices 
0. 
.7070, 
-7073, 
.7076, 
-7077, 
.7078, 
.708, 
.7082, 
.7084, 
.7085, 
.7086, 
.7089, 
.7091, 
-7093, 
.7094, 
.7098, 
.71, 
.7102, 
.7105, 
.7104, 
.7103, 
.7105, 
.7109, 
7111, 
.7112, 
.7115, 
-7118 


~-ooooo0o0oo0ooo0oo0o0o0o0o0o0o0o0o0o0o coco 0c 0c 0c 0 8 


we 
. 


7069, 
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DateTime eventStartaudchf = DateTime.now().minusMinutes(10) ; 
for (double price: audchfPrices) { 
eventStartaudchf = eventStartaudchf.plusSeconds(5); 
eventBus.post(new MarketDataPayLoad < String > (audchf, 
price - precision, price + precision, eventStartaudchf)) ; 
} 
fadeTheMoveStrategy.analysePrices(); 
TradingDecision < String > decision = orderQueue.take(); 
System.out.println(String. format ( 
"The strategy signaled to go %s on instrument %s at limit price 
%2.5f and take profit %2.5f ", 
decision.getSignal().name(), decision.getInstrument(). 
getInstrument(), 
decision.getLimitPrice(), decision.getTakeProfitPrice())); 
} 
} 


Here is the Spring configuration: 


<?xml version="1.0" encoding="UTF-8"?> 
<beans xmlns="http://www. springframework.org/schema/beans" 
xmlns:xsi="http: //www.w3.org/2001/XMLSchema-instance" 
xmlns:context="http: //www. springframework.org/schema/context" 
xmlns:tx="http://www. springframework.org/schema/tx" 
xsi:schemaLocation="http: //www. springframework.org/schema/beans 
http://www. springframework.org/schema/beans/spring-beans.xsd 
http://www. springframework.org/schema/context 
http://www. springframework.org/schema/context/spring-context.xsd"> 
<context:annotation-config/> 
<bean id="tradeableInstrumentList" class="java.util.ArrayList"> 
<constructor-arg index="0"> 
<list> 
<bean class="com.precioustech. 
fxtrading. instrument. 
TradeableInstrument"> 
<constructor-arg index="0" 
value="AUD_CHF"/> 
</bean> 
</list> 
</constructor-arg> 
</bean> 
<bean id="fadeTheMoveStrategy" 
class="com.precioustech. fxtrading.tradingbot. 
strategies .FadeTheMoveStrategy"> 
<constructor-arg index="0" ref="tradeableInstrumentList"/> 
</bean> 
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24 <bean id="tradingConfig" 
25 class="com.precioustech. fxtrading.tradingbot. 
TradingConfig"> 

26 <property name="minReserveRatio" value="0.1"/> 

27 <property name="maxAllowedQuantity" value="10"/> 

28 <property name="maxAllowedNetContracts" value="5"/> 

29 <property name="minAmountRequired" value="10.0"/> 

30 <property name="mailTo" value="foobar@gmail.com"/> 

31 <property name="max10yrWmaOffset" value="0.1"/> 

32 <property name="fadeTheMoveJumpReqdToTrade" value="45"/> 

33 <property name="fadeTheMoveDistanceToTrade" value="25"/> 

34 <property name="fadeTheMovePipsDesired" value="10"/> 

35 <property name="fadeTheMovePriceExpiry" value="15"/> 

36 </bean> 

37 <bean id="orderQueue" class="java.util.concurrent. 
LinkedBlockingQueue"/> 

38 <bean id="instrumentService" class="com.precioustech. fxtrading. 
instrument. InstrumentService"> 

39 <constructor-arg index="0" ref="instrumentDataProvider"/> 

40 </bean> 

41 <bean id="instrumentDataProvider" 


42  class="com.precioustech. fxtrading.oanda.restapi. instrument. 
OandaInstrumentDataProviderService"> 


43 <constructor-arg index="0" value="#{ 
systemProperties['oanda.url'] }"/> 

44 <constructor-arg index="1" value="#{ 
systemProperties['oanda.accountId'] }"/> 

45 <constructor-arg index="2" value="#{ 


systemProperties[ 'oanda.accessToken'] }"/> 
46 </bean> 
47 </beans> 
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Variabies... 
VM arguments: 
~Doanda.uriehttps://api-fxtrade.canda.com -Doanda.account!d= 209i 
Doanda.accessToken= 
Variables... 


Use the -XstartOnFirstThread argument when launching with SWT 


Working directory: 
© Default: 
© Other: 


Figure 9-2. Launch configuration 


= “euppert. ClessPotnielagelicotionContext®7Sesetce: stortup dete (Mon Feb O2 29:55:57 CLT 2026); 
~ Loeding WK been definitions from closs path resource (Fodethenove-deno. nal) 
= JSR-338 "Jovax. inject Inject’ annotation found and supported for outowiring 


15S: ~ Executing request : GET https: /: fxtrode conda .com/v1/ instruments Poccount 16-2O046646flelds~instrumenth2Cpipi2CinterestRete HTTP/1.1 
The stringy signalled to go SHORT on instrument AUO_CHF ct limit price @.71428 ond take profit ©.71328 


Figure 9-3. Output of trade signal 
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Heartbeating 


Heartbeats are a crucial element of any trading system. Any streaming or persistent 
connection over a long period of time must send a heartbeat down the pipe to let the 
consumer know that all is well and alive. Ours is no exception. In short, the heartbeat 
indicates the health of a system. 

The bot, in theory, should receive frequent heartbeats to be assured that all is well. If 
the heartbeat is irregular or exceeds the wait period for an expected heartbeat, it will try 
to reconnect and restore the passive event stream. 

In this chapter we discuss heartbeats, including how to process them and what to do 
if we stop receiving them. 


HeartBeatPayLoad 


Every persistent/streaming connection potentially can have different payloads to 
communicate the state of the connection. In order to accommodate for this wide range of 
payload types, we define the following POJO that models this characteristic: 


public class HeartBeatPayLoad < T > { 


private final T payLoad; 
private final String source; 


1 
2 
3 
4 
5 
6 public HeartBeatPayLoad(T payLoad) { 

7 this(payLoad, StringUtils.EMPTY) ; 

8 

9 

10 public HeartBeatPayLoad(T payLoad, String source) { 
11 this.payLoad = payLoad; 


12 this.source = source; 

13 } 

14 

15 public T getHeartBeatPayLoad() { 

16 return this.payLoad; 

17 } 

18 
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19 public String getHeartBeatSource() { 
20 return this. source; 

21 } 

22. +} 


The source attribute identifies the source of the heartbeat. This is to distinguish 
between different heartbeat sources in the system. For example in the trading bot system, 
we have at least two heartbeat streams, one for the tick data and the other for the trade/ 
order/account events. 


Streaming the Heartbeat Interface 


We begin, as we did for other streaming interfaces, with the interface definition that 
stipulates the minimum set of methods required to support heartbeat streaming. We have 
exactly the same design pattern as before: 


e Amethod to start the streaming 
e Amethod to stop the streaming 
e An infinite event loop to process the heartbeats 


e =§6©A callback interface to disseminate the event to downstream 
consumers 


Let’s look at the interface definition that defines this contract: 


1 /** 

2 * A service that provides streaming heartbeats from the trading 

3 * platform. The service provided in the end by the platform may not 
4 * be streaming at all but some sort of regular callbacks in order to 
5 * indicate that the connection is alive. A loss of heartbeats may 

6 * indicate a general failure to receive any trade/order events and/or 
7 * market data from the trading platform. Therefore any monitoring of 
8 * the application may involve directly interacting with this service to 
9 * raise alerts/notifications. 

10 ‘3 

i. = */ 

12. public interface HeartBeatStreamingService { 

13 

14 /** 

15 * Start the service in order to receive heartbeats from the trading 
16 * platform. Ideally the implementation would make sure that 

17 * multiple heartbeat connections/handlers are not created for the 
18 * same kind of service. Depending on the trading platform, there 

19 * may be a single heartbeat for all services or a dedicated one for 
20 * services such as market data, trade/order events etc. 

21 */ 
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22 void startHeartBeatStreaming(); 


23 

24 /** 

25 * Stop the service in order to stop receiving heartbeats. The 

26 * implementation must dispose any resources/connections in a 

27 * suitable manner so as not to cause any resource leaks. 

28 */ 

29 void stopHeartBeatStreaming() ; 

30 

31 /** 

32 3 

33 * @return heartBeat source id which identifies the source for which 
34 * this service is providing heartbeats. This is useful to keep track all 
35 * sources which are heartbeating and can be individually monitored 
36 * on a regular basis. On some platforms there may be a dedicated 

37 * single heartbeat service for ALL in which case this may not be as 
38 * useful. 

39 */ 

40 String getHeartBeatSourceld(); 

41 


This interface, unlike the other streaming interfaces, includes an additional method 
that stipulates the implementation to provide a unique source ID for the heartbeat stream 
implementation. 


A Concrete Implementation for 
HeartBeatStreamingService 


OANDA pushes the heartbeat events via the same stream, i.e., it uses the market data 
and trade/order/account event streams to intermittently push a heartbeat payload to 
communicate the well-being of the respective streams. An example heartbeat payload 
looks like this: 


1 {"heartbeat": {"time":"1443968021000000"}} 


Since both the OANDA streams push the same heartbeat payload, the abstract class 
OandaStreamingService, which is the base class for OandaEventsStreamingService 
and OandaMarketDataStreamingService, implements the interface and provides the 
plumbing to handle these heartbeats. Let’s look specifically at the implementation of 
the three interface methods in this abstract class. Additionally, we will also look at the 
method that parses out the JSON payload and the constructor. 


1 public abstract class OandaStreamingService 


2 implements HeartBeatStreamingService { 
3 protected OandaStreamingService(String accessToken, 
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4 HeartBeatCallback < DateTime > heartBeatCallback, String 
heartbeatSourceld) { 


5 this. hearbeatSourceId = heartbeatSourceld; 

6 this. heartBeatCallback = heartBeatCallback; 

7 aac 

8 

9 

10 protected void handleHeartBeat(JSONObject streamEvent) { 


11 Long t = Long.parseLong(((JSONObject) streamEvent.get(heartbeat)). 
get (time) .toString()); 

12 heartBeatCallback.onHeartBeat (new HeartBeatPayLoad < DateTime > 
(new DateTime(TradingUtils.toMillisFromNanos(t)), hear\ 

13 beatSourceld)); 

14 } 


16 @O0verride 

17 public void stopHeartBeatStreaming() { 
18 stopStreaming() ; 

19} 


21 @O0verride 

22 public void startHeartBeatStreaming() { 
23 if (!serviceUp) { 

24 startStreaming(); 

25 } 

26 } 

27 

28 @Override 

29 ~~ public String getHeartBeatSourceld() { 
30 return this.hearbeatSourceld; 

31 Sk 

32 

33 

34 

a5. -f 


The methods startHeartBeatStreaming() and stopHeartBeatStreaming() 
delegate to startStreaming() and stopStreaming() respectively, which further 
delegates to the underlying methods to start/stop the main streams. So in the case 
of market data streaming, the methods that start and stop the main stream are 
startMarketDataStreaming() and stopMarketDataStreaming(). This makes sense 
because the heartbeats are coupled with the main stream events and the two coexist. 
Stopping the heartbeat stream must stop the main stream and vice versa. 

The method handleHeartBeat parses the JSON payload and creates an instance 
of the HeartBeat-PayLoad<DateTime>. This is then passed on to an instance of 
HeartBeatCallback, which we discuss later in this chapter, to disseminate to downstream 
consumers. The timestamp in the heartbeat payload is the heartbeat timestamp and, as 
we will see later, it’s used later to figure out if the stream is still alive or dead. 
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HeartBeatCallback Interface 


Like the other callback that we have looked at so far, the HeartBeatCallback is no different. 
It is directly invoked by the provider implementation that is directly receiving streaming 
events from the platform. After parsing the event and creating a HeartBeatPayLoad 
instance, the onHeartBeat method is invoked. Let’s jump directly to how the source code 
looks. 


public interface HeartBeatCallback<T> { 


1 
2 
3 void onHeartBeat (HeartBeatPayLoad<T> payLoad) ; 
4 } 


The implementation for this interface is similar to other callback interfaces we have 
discussed previously. The HeartBeatPayLoad is disseminated to downstream consumers 
via the EventBus: 


1 public class HeartBeatCallbackImpl < T > implements HeartBeatCallback 


<Tof 
2 
3 private final EventBus eventBus; 
4 
5 public HeartBeatCallbackImpl(EventBus eventBus) { 
6 this.eventBus = eventBus; 
7 } 
8 
9 @Override 
10 public void onHeartBeat(HeartBeatPayLoad < T > payLoad) { 
11 this .eventBus.post (payLoad) ; 
12 } 
13 
14 } 


DefaultHeartBeatService 


We are now ready to discuss the service that uses heartbeat payloads to keep track 
of the health of various streaming connections and tries to revive them if they stop 
sending heartbeats. The DefaultHeartBeatService service, which extends from 
AbstractHeartBeatService, consumes the heartbeat payloads posted by the 
HeartBeatCallback via the EventBus. Every heartbeat received for the given source helps 
the service keep track of the health of the given stream. 

We first look at the constructor that is injected into all the instances of 
HeartBeatStreamingService in a collection that it must keep track of. 
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protected abstract boolean isAlive(HeartBeatPayLoad < T > payLoad); 
2 protected static final long MAX_HEARTBEAT DELAY = 60000 L; 
3 private final Map < String, HeartBeatStreamingService > 
heartBeatProducerMap = 
4 Maps .newHashMap() ; 
5 private final Map < String, HeartBeatPayLoad < T >> payLoadMap = 
6 Maps .newConcurrentMap() ; 
7 volatile boolean serviceUp = true; 
8 protected final Collection < HeartBeatStreamingService > 
9 heartBeatStreamingServices; 
0 protected final long initWait = 2000 L; 
11 long warmUpTime = MAX_HEARTBEAT DELAY; 


13 public AbstractHeartBeatService(Collection < HeartBeatStreamingService > 
14 ~heartBeatStreamingServices) { 

15 this.heartBeatStreamingServices = heartBeatStreamingServices; 

16 for (HeartBeatStreamingService heartBeatStreamingService: 


17 heartBeatStreamingServices) { 

18 this .heartBeatProducerMap . put ( 

19 heartBeatStreamingService.getHeartBeatSourceld(), 
20 heartBeatStreamingService) ; 

21 } 

22 +} 


The constructor also populates the heartBeatProducerMap with each instance of 
HeartBeatStreamingService keyed by its source ID inside the map. The payLoadMap 
is a map that has the last HeartBeatPayLoad object for the given heartbeat source. It 
constantly gets heartbeats for various sources via the EventBus subscriber method. 


@Subscribe 
@AllowConcurrentEvents 
public void handleHeartBeats(HeartBeatPayLoad<T> payLoad) { 
this. payLoadMap.put (payLoad.getHeartBeatSource(), payLoad); 
i 
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What we need now is a background thread to periodically check the last time a 
payload was received. If it breaches the threshold limit for delay allowed for heartbeats, 
we try to revive it by calling the startHeartBeatStreaming() method. 


1  @PostConstruct 

2 public void init() { 

3 this. heartBeatsObserverThread.start(); 

4 } 

5 

6 final Thread heartBeatsObserverThread = new Thread(new Runnable() { 
7 
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private void sleep() { 
try { 


Thread.sleep(warmUpTime); /*let the streams start naturally*/ 


} catch (InterruptedException e1) { 


LOG.error(e1) ; 


@Override 
public void run() { 
while (serviceUp) { 


sleep(); 
for (Map.Entry < String, HeartBeatStreamingService > entry: 
heartBeatProducerMap.entrySet()) { 
long startWait = initWait; // start with 2secs 
while (serviceUp && !isAlive(payLoadMap.get(entry.getKey()))) { 
entry.getValue().startHeartBeatStreaming(); 
LOG.warn(String 
. format ("heartbeat source %s was not responding." + 
"Just restarted it and will listen for heartbeat after %d ms", 
entry.getKey(), startWait)); 
try { 
Thread.sleep(startWait) ; 
} catch (InterruptedException e) { 
LOG.error(e); 


//double the sleep time but not more than MAX_HEARTBEAT_DELAY 
startWait = Math.min(MAX HEARTBEAT DELAY, 2 * startWait); 

} 

: 


}, "HeartBeatMonitorThread") ; 


The @PostConstruct annotated method init() launches the 


heartBeatsObserverThread background thread. This thread periodically wakes up 

and loops through the heartBeatProducerMap for each of the entries in the map, and 
then checks if the streaming service is alive. The isAlive method that does the check is 
implemented by the DefaultHeartBeatService. 


1 
2 
3 
4 
5 
6 
7 
8 


public class DefaultHeartBeatService 
extends AbstractHeartBeatService < DateTime > { 


public DefaultHeartBeatService(Collection < HeartBeatStreamingService > 
heartBeatStreamingServices) { 
super (heartBeatStreamingServices) ; 
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9 @O0verride 

10 protected boolean isAlive(HeartBeatPayLoad < DateTime > payLoad) { 
11 return payLoad != null && (DateTime.now().getMillis() - 

12 payLoad.getHeartBeatPayLoad().getMillis()) < MAX_HEARTBEAT DELAY; 
13} 

14 

15} 


This service, as you see from this code, expects a HeartBeatPayLoad<DateTime>. 
The isAlive implementation uses the payload that has a DateTime and then does 
some date calculations to figure out if the time since the last payload was received has 
breached the MAX_HEARTBEAT_DELAY. If it hasn’t, the streaming connection is deemed 
to be alive; otherwise, it’s not. Going back to the background thread code, if isAlive 
returns false, we then try to restart the streaming connection via invocation to 
startHeartBeatStreaming(). If the streaming connection restarts successfully, the posts 
to the handleHeartBeats method resume and isAlive then returns true. 

There may be cases where other platforms might send a dummy object or 
a string down the pipe to communicate that it is heartbeating. In such cases, the 
DefaultHeartBeatService may be inadequate. For these, we may have to create a 
wrapper payload that includes the original payload and the time it was received by 
the handleHeartBeats method. The wrapper payload may have to be then passed 
on to another implementation, which extends the AbstractHeartBeatService and 
implements isAlive accordingly. 

This concludes our discussion of the heartbeat mechanism of the bot. The 
heartbeats are an extremely important functionality of the bot because they tell us the 
health of the streams that are core to the functioning of the bot. A lot of the strategies 
might depend on the tick data stream and hence we cannot afford to have it down for a 
long period of time. Similarly we need to have the trade/order/account stream up and 
running so that the caches are in sync with the platform. 


Try It Yourself 


In this section we are going to write a demo program that demonstrates how the 
DefaultheartBeatService revives a dead stream once it detects that it has died. 


1 package com.precioustech. fxtrading.heartbeats ; 
2 

3 import java.util.Collection; 

4 

5 import org.apache.commons.lang3.StringUtils ; 

6 import org.apache.log4j.Logger; 

7 import org. joda.time.DateTime; 

8 

9 import com.google.common.collect.Lists ; 

0 


import com.google.common.eventbus.AllowConcurrentEvents ; 
11 import com.google.common.eventbus.EventBus ; 
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import com.google.common.eventbus. Subscribe; 

import com.precioustech. fxtrading. instrument. TradeableInstrument ; 
import com.precioustech. fxtrading.marketdata.MarketEventCallback; 
import com.precioustech. fxtrading.marketdata.MarketEventHandlerImp] ; 
import com.precioustech. fxtrading.oanda.restapi.streaming.marketdata. 
OandaMarketDataStreamingService ; 

import com.precioustech. fxtrading.streaming. heartbeats. 
HeartBeatStreamingService ; 


public class DefaultHeartBeatServiceDemo { 


private static final Logger LOG = Logger.getLogger(DefaultHeartBeatSe 
rviceDemo.class); 


private static void usageAndValidation(String[] args) { 
if (args.length != 3) { 
LOG.error("Usage: DefaultHeartBeatServiceDemo <url> <accountid> 
<accesstoken>"); 
System.exit(1); 
} else { 
if (!StringUtils.isNumeric(args[1])) { 
LOG.error("Argument 2 should be numeric"); 
System.exit(1); 
} 
} 
} 


private static class DataSubscriber { 


@Subscribe 
@AllowConcurrentEvents 
public void handleHeartBeats(HeartBeatPayLoad < DateTime > payLoad) { 
LOG. info( 
String. format("Heartbeat received @ %s from source %s", 
payLoad.getHeartBeatPayLoad(), payLoad.getHeartBeatSource())); 


} 


@SuppressWarnings ("unchecked") 
public static void main(String[] args) throws Exception { 
usageAndValidation(args) ; 

final String url = args[0]; 

final Long accountId = Long.parseLong(args[1]); 

final String accessToken = args[2]; 

final String heartbeatSourceId="DEMO_MKTDATASTREAM" ; 
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55 TradeableInstrument < String > eurusd = new TradeableInstrument 
< String > ("EUR_USD"); 

56 

57 Collection < TradeableInstrument < String >> instruments = Lists. 
newArrayList(eurusd) ; 


58 

59 EventBus eventBus = new EventBus(); 

60 

61 MarketEventCallback < String > mktEventCallback = 
62 new MarketEventHandlerImpl < String > (eventBus); 


63 HeartBeatCallback < DateTime > heartBeatCallback = 

64 new HeartBeatCallbackImpl < DateTime > (eventBus); 

65 

66 OandaMarketDataStreamingService mktDataStreaminService = 


67 new OandaMarketDataStreamingService(url, accessToken, 

68 accountId, instruments, mktEventCallback, heartBeatCallback, 
heartbeatSourcelId) ; 

69 mktDataStreaminService. startMarketDataStreaming() ; 

70 Collection < HeartBeatStreamingService > heartbeatstreamingLst = 
Lists.newArrayList(); 

71 heartbeatstreamingLst.add(mktDataStreaminService) ; 

72 DefaultHeartBeatService heartBeatService = new 
DefaultHeartBeatService(heartbeatstreamingLst) ; 

73 eventBus. register (heartBeatService) ; 

74 eventBus.register(nmew DataSubscriber()); 

75 heartBeatService.init(); 

76 

77 heartBeatService.warmUpTime = 5000 L; 


78 Thread.sleep(30000 L); 

79 mktDataStreaminService.stopMarketDataStreaming(); 
80 Thread.sleep(20000 L); 

81 } 

82 

83 } 
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Name: DefaultHeartBeatServiceDemo 


© vi amma, ma ns cena 


Program arguments: 


a 


VM arguments: 


Working directory: 
© Default: 


Other: 


]y Source Environment | 


7 common| 


https://stream-fxtrade.oanda.com 2Gt6G% GGVOORORIO4E0ESGe000esOdOI200060- 
DARED IIALLD ALL ONO INCL AL OSI ALS 


© Use the -XstartOnFirstThread argument when launching with SWT 


Variables. oe 


Variables... 


Figure 10-1. Launch configuration 


Close 


<terminated> OefautHeartBeatServiceOemo [Java Azcication! (Ubrary\JavalJavaVirtusiMochines/idet.7.0_71 idesComierts/omelbinijave (2 Feb 2016 18:17:06) 


18:17:08,466 INFO [CondMorketOotaStreawingThreod) - Executing 


18:17:10,269 INFO [OondMarketOataStreavingThreod) - Heartbeat 
18:17:12,874 INFO [QandMorketOotaStreeringThresd) - Weortbeat 
u ([RendMorketOctaStreeringThresd) - Neertbest 
(DendMorketOetaSt-eeringThresd) - Heartbest 
(DandMarketDotaStrearingThread) - Heartbeat 
(OandMarketQotaStrearingthread) - Heartbeat 
[OondMorketOotaStrearingThreod) - Heortbeot 
[OondMarketQotaStrearingThresd) - Keortbeot 

17:30,288 INFO [OondMorketOotaStreoringThreod) - Keortbeot 


17:32,842 INFO 
17:35,246 INFO 
47: 37,628 INFO 


Heartbeat 
Heartbeat 
Heartbeat 


[OandMarketOotaStrearingThresd) - 
[OondMarketOotaStrearingThread) - 
(OandMarketOataStreawingThread) - 


38,067 WARN 
8: 38,227 INFO 


[MeartBeatMonitorthread) - heartbect source 
WendMorketOotoStrearingThreod) - Executing 
[HeortBectMonitorthreed) - heartbect source 
[DendMarketOotaStreaningThrecd) - heartbeat 
[OandMarketSotaStrearingThresd) - Heartbeat 
[OondMarketOotaStreawingThread) = Keortbeat 
7,818 INFO - 
50,129 INFO - 


[DondMarketOotoStreavingthresd) - Heartbeat 


2016-02-02 [OandMarketOataStreawingThread) - Heartbeat 


Figure 10-2. Sample output 


less Joveteunchitelper is implemented in both /Librery/Java/JovavirtwalMochines/ jdki. 7. 


2016-82-82728 217: 10. 12468120 fron 


received @ 2016-82-82T18:17:20.125. 
received @ 2016-02-02718117:22.6444) 
received @ 2016-02-02728:17:25. 128+! 
received @ 2016-02-82718:17:27. 8194: 


180 From 
100 from 
100 from 
180 from 
00 fron 
00 from 
00 from 


received @ 2016-@2-02728:17: 37.711 00 fron 


source DEMO_METOATASTREAM 
source DIMO_METOATASTREAM 
source DIMO_METOATASTREAM 
source DEMO_METDATASTRIAM 
source DEMO_MKTOATASTREAM 
source DEMO_METOATASTREAM 
source OLMO_METOATASTREAM 
source OEMO_METOATASTREAM 
source DEMO_METOATASTREAM 
source DEMO_METOATASTREAM 
source OFMO_METOATASTREAM 
source DEMO_METOATASTREAM 


2 GET https://stream-fxtrode.oanda. com/vi/prices? account [d= 708094hinstruments=EUR_USD MTTF 


‘1. }@&/Contents/Mome/bin/ java end /Librery/Jove/JevaVirtuelMechines/ je 


OLMO_MKTOATASTREAM is not responding. just restorted it and will listen for heartbeet after 2008 «+ 
request : GET https://streom-fxtrede. conde. com/vi/prices account 1é-Desepabinstruments={UR_USO NITE 
OCMO_MKTOATASTREAM is not responding, just restorted it and will Listen for heortbest ofter 4002 # 


706601:00 from 
received @ 2016-@2-82718:18:50.127+01:00 frow 


Source DEMO_METOATASTRCAM 
source DEMO_METOATASTREAM 
source DEMO_METOATASTREAM 
source DEMO_METOATASTREAM 
source DEMO_METOATASTREAM 


After a bit of time, the market data stream is stopped. The heartBeatService then 
tries to revive it and is successful in doing so. We see heartbeats being received again after 
the connection is successfully reestablished. 
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E-Mail Notifications 


In this chapter we discuss e-mail notifications that are extremely useful to notify users 
when certain events are triggered inside the bot. These notifications are closely coupled 
to the trade/order/account events discussed in the Chapter 7. As a result, the e-mail 
notification component has the same input payload, delivered by the EventBus, as the 
other handlers we discussed in that chapter. These notifications can be very useful 
when a user action is urgently warranted. For example, a MARGIN _CALL_ENTER' might 

be triggered on the OANDA platform, which suggests that the account faces an urgent 
margin call. On the other hand, these notifications serve as a useful tool to keep track of 
what the automated trading bot is up to. By switching on notifications for trade/order 
and account events, users can have a useful appreciation of the state of things happening 
inside the bot. 


Notification Design 


As discussed, the event that is handled by the trade/order and account event handlers 

is also posted to the e-mail notification service. This service, EventEmailNotifier, 

handles this event and generates an e-mail if an appropriate EmailContentGenerator is 

configured for that event. The EmailContentGenerator implementation is responsible for 

generating subject and body, aka the EmailPayLoad, and it can vary from event to event. 
Let’s first look at the POJO EmailPayLoad that holds the result of the e-mail content 

generation. 


EmailPayLoad POJO 


public class EmailPayLoad { 
private final String subject; 
private final String body; 
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5 public EmailPayLoad(String subject, String body) { 
6 super(); 

7 this.subject = subject; 

8 this. body = body; 
9 

0 


} 
1 
11 public String getSubject() { 
12 return subject; 
13°} 
14 
15 public String getBody() { 
16 return body; 
17 } 
18 
19} 


The EmailPayLoad has the subject and the body of the e-mail that is sent out using 
the JavaMail API and configured inside the Spring configuration. 


EmailContentGenerator Interface 
1 public interface EmailContentGenerator<T> { 
: EmailPayLoad generate(EventPayLoad<T> payLoad) ; 


} 


Sample Implementations 


In this section, we discuss some sample implementations of the EmailContentGenerator 
interface. First, we look at an implementation that sends an e-mail out if the following 
trade events are generated by the platform 


e Trade closed 
e Stop loss triggered 
e Take profit triggered 


When a take profit level is hit, for example, we can expect a JSON response like the 
following one: 


{ 
"id": 10003, 
“accountId" : 234567, 
"time" :"1443968061000000", 
"type": "TAKE PROFIT FILLED", 
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"tradeId" : 1800805337, 
"instrument": "USD CHF", 
"units" : 3000, 

"side": "sell", 

"price": 1.00877, 

"pl" :3.48, 

"interest" :0.0002, 
"accountBalance" :5912.5829 


} 


The TradeEventHandler that handled the trade events from the OANDA platform 


also implements the EmailContentGenerator interface. As a result, the method that 
generates the EmailPayLoad looks like this: 


1 @Override 

2 public EmailPayLoad generate(EventPayLoad < JSONObject > payload) { 

3 JSONObject jsonPayLoad = payLoad.getPayLoad(); 

4 TradeableInstrument < String > instrument = new TradeableInstrument 
< String > (jsonPayLoad.get( 

5 OandaJsonKeys. instrument) .toString()); 

6 final String type = jsonPayLoad.get(OandaJsonKeys.type) .toString(); 

7 final long accountId = (Long) jsonPayLoad.get(OandaJsonKeys. 
accountId) ; 

8 final double accountBalance = ((Number) jsonPayLoad.get(OandaJsonKeys. 
accountBalance) ).doubleValue(); 

9 final long tradeId = (Long) jsonPayLoad.get(OandaJsonKeys.tradeId) ; 

10 final double pnl = ((Number) jsonPayLoad.get(OandaJsonKeys.pl)). 
doubleValue(); 

11 final double interest = ((Number) jsonPayLoad.get(OandaJsonKeys. 
interest) ).doubleValue(); 

12 final long tradeUnits = (Long) jsonPayLoad.get(OandaJsonKeys.units) ; 

13 final String emailMsg = String 

14 .format("Trade event %s received for account %d. "+ "Trade id=%d. 

Pnl=%5.3f, Interest=%5.3f, Trade Units=%d. " + "Acc\ 
15 ount balance after the event=%5.2f", 
16 type, accountId, tradeId, pnl, interest, tradeUnits, 
accountBalance) ; 

17 final String subject = String. format( 

18 "Order event %s for %s", type, instrument.getInstrument()); 

19 return new EmailPayLoad(subject, emailMsg); 

20 +} 

This code extracts key pieces of information such as the following from the 
JSONObject: 


e =PNL 


e Interest 


233 


CHAPTER 11 | E-MAIL NOTIFICATIONS 


e Account ID 
e Account balance 
It then creates the following body for the e-mail for our JSON response: 
1 Trade event TAKE PROFIT FILLED received for account 234567. 
2 Trade id=1800805337. Pnl=3.48, Interest=0, Trade Units=3000. 
3 Account balance after the event=5912.58 
The subject generated is 


1 Order event TAKE PROFIT FILLED for USD CHF 


The next example covers an order filled event. When such an event happens, you 
could expect a JSON like this one from the OANDA platform: 


: a 

2 "id": 10002, 

3 "accountId": 123456, 

4 "time": "1443968041000000", 
5 "type": "ORDER FILLED", 
6 “instrument”: "EUR USD", 
7 "units": 10, 

8 "side": "sell", 

9 "price": 1, 

10 "pl": 1.234, 

11 "interest": 0.034, 

12 "accountBalance": 10000, 
13 “orderId": 0, 

14 "tradeReduced": { 

15 "id": 54321, 

16 "units": 10, 

17 "pl": 1.234, 

18 "interest": 0.034 

19 } 

20 +} 


The OrderFilledEventHandler handled the order filled events from the OANDA 
platform, and it also implements the EmailContentGenerator interface. As a result, the 
method that generates the Email PayLoad looks like this: 


@Override 
public EmailPayLoad generate(EventPayLoad < JSONObject > payload) { 
JSONObject jsonPayLoad = payLoad.getPayLoad(); 
TradeableInstrument < String > instrument = new TradeableInstrument 
< String > (jsonPayLoad 
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5 .containsKey(OandaJsonKeys.instrument) ? jsonPayLoad. 
get (OandaJsonKeys.instrument).toString() : "N/A"); 
6 final String type = jsonPayLoad.get(OandaJsonKeys.type) .toString(); 
7 final long accountId = (Long) jsonPayLoad.get(OandaJsonKeys. 
accountId) ; 
8 final double accountBalance = jsonPayLoad. 
9 containsKey(OandaJsonKeys.accountBalance) ? ((Number) jsonPayLoad 
10 . get (OandaJsonKeys.accountBalance) ).doubleValue() : 0.0; 
11 final long orderId = (Long) jsonPayLoad.get(OandaJsonKeys.id) ; 
12 final String emailMsg = String. format ( 


13 "Order event %s received on account %d. Order id=%d. " + "Account 
balance after the event=%5.2f", type, 

14 accountId, orderId, accountBalance); 

15 final String subject = String. format( 

16 "Order event %s for %s", type, instrument.getInstrument()); 

17. ~—s return new EmailPayLoad(subject, emailMsg); 

18 =} 


This code like the previous example. It extracts some key bits of information to 
prepare the e-mail body. These include 


e Account ID 
e Account balance 
e Order ID 
For this example, the following body would be produced. 


1 Order event ORDER FILLED received on account 123456. Order id=10002. 
2 Account balance after the event=10000.00 


and the subject would be 


1 Order event ORDER FILLED for EUR USD 


EventEmailNotifier Service 


The EventEmailNotifier is a simple service that has a eventEmailContentGeneratorMap 
that is injected by Spring and configured inside the app Spring configuration file. The 
map is keyed by an instance of the Event interface and the value is an implementation 

of the EmailContentGenerator interface. When an EventPayLoad is received by the 
EventBus inside the notifyByEmail method, this map is searched for an appropriate 
instance of EmailContentGenerator that could handle this payload. If found, this 
instance then generates an EmailPayLoad instance. This is then used to construct a 
SimpleMailMessage and sent out by the mailSender. 
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28 
29 
30 


public class EventEmailNotifier < T > { 


private static final Logger LOG = Logger.getLogger(EventEmailNotifier. 
class); 


@Autowired 

JavaMailSender mailSender; 

@Resource 

Map < Event, 

EmailContentGenerator < T >> eventEmailContentGeneratorMap; 
@Autowired 

TradingConfig tradingConfig; 


@Subscribe 
@AllowConcurrentEvents 
public void notifyByEmail(EventPayLoad < T > payLoad) { 
Preconditions.checkNotNull(payLoad) ; 
EmailContentGenerator < T > emailContentGenerator = 
eventEmailContentGeneratorMap. get (payLoad.getEvent()); 
if (emailContentGenerator != null) { 
EmailPayLoad emailPayLoad = emailContentGenerator.generate(payLoad) ; 
SimpleMailMessage msg = new SimpleMailMessage(); 
msg.setSubject (emailPayLoad.getSubject()); 
msg.setTo(tradingConfig.getMailTo()); 
msg.setText(emailPayLoad.getBody()); 
this .mailSender.send(msg) ; 
} else { 
LOG.warn("No email content generator found for event:" + payLoad. 
getEvent().name()); 
} 
} 
} 


We gain a better appreciation if we take a quick look at the Spring config file where 


we configure the events that we want to send notifications out for. 


NF 


anu &w 
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<bean id="orderEventHandler" 
class="com.precioustech. fxtrading.oanda.restapi.events. 
OrderFilledEventHandler"> 
<constructor-arg index="0" ref="tradeInfoService"/> 
</bean> 
<bean id="tradeEventHandler" 
class="com.precioustech. fxtrading.oanda.restapi.events. 
TradeEventHandler"> 
<constructor-arg index="0" ref="tradeInfoService"/> 
</bean> 
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<util:map id="eventEmailContentGeneratorMap" key-type="com. 
precioustech. fxtrading.events.Event"> 
<entry key="#{T(com.precioustech. fxtrading.oanda.restapi. 
events.OrderEvents) .MARKET ORDER _CREATE}" 
value-ref="orderEventHandler"/> 
<entry key="#{T(com.precioustech. fxtrading.oanda.restapi. 
events .OrderEvents).LIMIT ORDER CREATE}" 
value-ref="orderEventHandler"/> 
<entry key="#{T(com.precioustech. fxtrading.oanda.restapi. 
events.OrderEvents) .ORDER_CANCEL}" 
value-ref="orderEventHandler"/> 
<entry key="#{T(com.precioustech. fxtrading.oanda.restapi. 
events.OrderEvents).ORDER_FILLED}" 
value-ref="orderEventHandler"/> 
<entry key="#{T(com.precioustech. fxtrading.oanda.restapi. 
events. TradeEvents). TRADE CLOSE}" 
value-ref="tradeEventHandler"/> 
<entry key="#{T(com.precioustech. fxtrading.oanda.restapi. 
events. TradeEvents).STOP_LOSS FILLED}" 
value-ref="tradeEventHandler"/> 
<entry key="#{T(com.precioustech. fxtrading.oanda.restapi. 
events. TradeEvents).TAKE PROFIT FILLED}" 
value-ref="tradeEventHandler"/> 
</util:map> 


In this config, we first configure the two handlers—OrderFilledEventHandler and 


TradeEventHandler—that would handle events of type OrderEvents and TradeEvents 
respectively, both being the implementations of the Event interface. We then pick our 
events we want the send notifications out for and configure them here. 


This concludes our short discussion of the e-mail notifications. 


Try It Yourself 


In this section we are going to write a sample Spring configured demo program in 
which we simulate the posting of a trade event using the EventBus and see the actual 
notifications turn up in the mailbox. First let’s look at the code. 


NOW PWN PR 


package com.precioustech. fxtrading.tradingbot.events notification. email ; 
import java.util.Map; 

import org. json.simple.JSONObject ; 

import org.springframework.context.ApplicationContext ; 


import org.springframework. context. support. 
ClassPathXmlApplicationContext ; 
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9 import com.google.common.collect.Maps ; 

10 import com.google.common.eventbus.EventBus ; 

11 import com.precioustech.fxtrading.events.EventPayLoad ; 

12 import com.precioustech.fxtrading.oanda.restapi.OandaJsonKeys ; 

13. import com.precioustech.fxtrading.oanda.restapi.events.TradeEvents ; 


15 public class EventEmailNotifierDemo { 
17 @SuppressWarnings ("unchecked") 


18 public static void main(String[] args) { 
19 ApplicationContext appContext = 


20 new ClassPathXmlApplicationContext("emailnotify-demo. xml") ; 
21 EventEmailNotifier < JSONObject > emailNotifier = 

22 appContext. getBean(EventEmailNotifier.class) ; 

23 EventBus eventBus = new EventBus(); 

24 eventBus. register (emailNotifier) ; 

25 


26 Map < String, Object > payload = Maps.newHashMap(); 

27 payload.put(OandaJsonKeys.instrument, "GBP USD"); 

28 payload.put(OandaJsonKeys.type, TradeEvents.TAKE PROFIT FILLED.name()); 

29 payload.put(OandaJsonKeys.accountId, 123456 1); 

30 payload.put(OandaJsonKeys.accountBalance, 127.8); 

31 payload.put(OandaJsonKeys.tradeId, 234567 1); 

32 payload.put(OandaJsonKeys.pl, 11.8); 

33 payload.put(OandaJsonKeys.interest, 0.27); 

34 payload.put(OandaJsonKeys.units, 2700 1); 

35 

36 JSONObject jsonObj = mew JSONObject (payload) ; 

37 eventBus.post(mew EventPayLoad < JSONObject > (TradeEvents.TAKE_ 
PROFIT FILLED, jsonObj)); 

38 } 

39 

40 } 


In the following code, we create an instance of JSONObject by hand and post it to the 
EventBus. The configuration that drives this program looks like this: 


1 <?xml version="1.0" encoding="UTF-8"?> 

2. <beans xmlns="http://www. springframework.org/schema/beans" 

3 xmlns:xsi="http: //www.w3.org/2001/XMLSchema-instance" 

4 xmlns:context="http: //www. springframework.org/schema/context" 

5 xmlns:util="http://www. springframework.org/schema/util" 

6 xmlns:task="http://www. springframework.org/schema/task" 

7 xmlns:tx="http: //www. springframework.org/schema/tx" 

8 xsi:schemaLocation="http: //www. springframework.org/schema/beans 
9 http://www. springframework.org/schema/beans/spring-beans.xsd 

0 http://www. springframework.org/schema/context 

11 http://www. springframework.org/schema/context/spring-context.xsd 


238 


12 
13 
14 
15 


16 


17 


18 


19 


20 
21 
22 
23 
24 
25 


26 
27 


28 
29 
30 
31 
32 


33 
34 
35 
36 
37 


38 
39 


40 


41 
42 
43 
44 
45 


46 


CHAPTER 11 | E-MAIL NOTIFICATIONS 


http://www. springframework.org/schema/util 
http://www. springframework.org/schema/util/spring-util.xsd"> 
<context:annotation-config/> 
<bean id="mailSender" class="org.springframework.mail.javamail. 
JavaMailSenderImp1"> 

<property name="host" value="#{ systemProperties['mail.host' ] 


}"I> 


<property name="port" value="#{ systemProperties[ 'mail.port' ] 


}"I> 


<property name="username" value="#{ systemProperties['mail. 
user'] }"/> 
<property name="password" value="#{ systemProperties['mail. 
password'] }"/> 
<property name="javaMailProperties"> 

<props> 


<prop key="mail.transport.protocol">smtps</prop> 
<prop key="mail.smtp.auth">true</prop> 

<prop key="mail.smtp.starttls.enable">true</prop> 
<prop key="mail.smtp.socketFactory.class">javax.net. 
ssl.SSLSocketFactory</prop> 

<prop key="mail.debug">false</prop> 

<prop key="mail.smtp.socketFactory.fallback">false 
</prop> 


</props> 
</property> 


</bean> 


<bean id="tradingConfig" 


</bean> 


class="com.precioustech. fxtrading.tradingbot. 
TradingConfig"> 
<property name="minReserveRatio" value="0.1"/> 
<property name="maxAllowedQuantity" value="10"/> 
<property name="maxAllowedNetContracts" value="5"/> 
<property name="minAmountRequired" value="10.0"/> 
<property name="mailTo" value="#{ 
systemProperties['mail.to'] }"/> 
<property name="max10yrWmaOffset" value="0.1"/> 
<property name="fadeTheMoveJumpReqdToTrade" 
value="45"/> 
<property name="fadeTheMoveDistanceToTrade" 
value="25"/> 
<property name="fadeTheMovePipsDesired" value="10"/> 
<property name="fadeTheMovePriceExpiry" value="15"/> 


<bean id="eventEmailNotifier" 


class="com.precioustech. fxtrading.tradingbot. 
events.notification.email.EventEmailNotifier"/> 


<bean id="tradeEventHandler" 
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47 class="com.precioustech. fxtrading.oanda.restapi. 
events. TradeEventHandler"> 

48 <constructor-arg index="0"> 

49 <null/> 

50 </constructor-arg> 

51 </bean> 

52 

53 <utilsmap id="eventEmailContentGeneratorMap" key-type="com. 

precioustech. fxtrading.events.Event"> 
54 <entry key="#{T(com.precioustech. fxtrading.oanda. 
restapi.events.TradeEvents).TRADE CLOSE}" 

55 value-ref="tradeEventHandler"/> 

56 <entry key="#{T(com.precioustech. fxtrading.oanda.restapi. 
events. TradeEvents).STOP_ LOSS FILLED}" 

57 value-ref="tradeEventHandler"/> 

58 <entry key="#{T(com.precioustech. fxtrading.oanda.restapi. 
events. TradeEvents).TAKE PROFIT FILLED}" 

59 value-ref="tradeEventHandler"/> 

60 </util:map> 


61 </beans> 


Since all the e-mail account credentials are passed in system properties, let’s look at 
the launch configuration shown in Figure 11-1. 
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Name: EventEmailNotifierDemo 
© Main (> Arguments B JRE & Classpath |» Source MB Environment [) Common 


Program arguments: 


Variables... 


VM arguments: 


~Dmail.to=shekhar.varshney@gmail.com -Dmail.host=smtp.gmail.com -Dmail.port=465 -Dmail.user=werteederbot@gmail.com 
-Dmail.password= teavinegeot@Ots 


Variables... 
Use the -XstartOnFirstThread argument when launching with SWT 
Working directory: 
© Defauit: 
Other: 
Close Run 


Figure 11-1. Launch configuration 


After the program is successfully run, we see the e-mail turning up in the mail.to 
address with the values we used in our test program, as shown in Figure 11-2. 


ts] o i | - More ~ < 
Order event TAKE_PROFIT_FILLED for GBP_USD inbox x * Lh 
A 
— binasctredeetat@gmail.com 18:33 (13 minutes ago) ra = 


Important 
Sent Mail 


tome = 


y Trade event TAKE_PROFIT_FILLED received for account 123456. Trade id=234567. Pni=11.800, interest=0.270, Trade 
Drafts (0) Units=2700. Account balance after the event=127.80 


Spam 


Figure 11-2. E-mail notification arrives in the inbox 
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Configuration, Deployment, 
and Running the Bot 


We are now all set to put the bot into action. All that remains before pressing the button is 
the configuration and deployment. Configuration of the bot involves the following steps: 


e Spring configuration of the core services and API, i-e., 
tradingbot-app.xml. 


e Property file for the core Spring configuration, i.e., 
tradingbot.properties. 


e Spring configuration of the runtime provider (OANDA in our 
case), ie., tradingbot-oanda. xml. 


e Property file for the runtime provider Spring configuration, 
ie., tradingbot-oanda. properties. 


Just like the JAR files, we also have a separate configuration file for the runtime 
provider. As we will see later in the chapter, the name of the provider configuration file is 
passed in as a program argument in order to easily pick the provider at runtime. Without 
further ado, let’s jump into the configuration of the bot. 


Configuring the Trading Bot 


We start by creating the main configuration file in the tradingbot-app project in the 
src/main/resources folder, which is automatically included in the build and as a result 
ends up inside the tradingbot-app. jar file. The name of the file is tradingbot-app. xml. 
We also create the properties file, called tradingbot . properties, that has the values for 
various placeholders referenced in this Spring configuration file. 

We also use the cool SpEL’' in our configuration, the reason for which will become 
clear as we progress through this chapter. 


'http://docs.spring.io/spring/docs/current/spring-framework-reference/html/ 
expressions .html 
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Core Beans Configuration 


In this section, we configure all the core beans that are part of the core API except the 
services which we will configure later. These beans include e-mail, queues, trading 
config, etc. which are central to the functioning of the bot. 

Since all our dependency beans are @Autowired, we switch on annotation processing 
by including <context : annotation-config/> in the configuration file. This will ensure 
that all the dependencies we have injected via @Autowired will be processed correctly. We 
also switch on property file processing by including the following in the configuration file 
and also specify where to find the properties file: 


1  <context:property-placeholder location="classpath:tradingbot.properties" 
ignore-unresolvable="true"/> 


The trading. properties has the following properties. We added some sample 
values to demonstrate how they look: 


mail.to=tradingbot@gmail.com 

mail. host=smtp.gmail.com 

mail.port=465 

mail.user=foobar@gmail.com 

mail. password=foobar123 

twitter. consumerKey=veJerryUYUDHU1iDXj1C604KR 

twitter. consumerSecret=L5iFptFbLKMyUoH8NB3yAodEeoEQMukriUt3mnNICEKy 

Np20Ih 

8 twitter.accessToken=0123456789-LISP3Y00mL gDOSw44vgdVORr7313Zy 
PrAtoXx3jU 

9 twitter.accessTokenSecret=5IrbOYULGOLd7UPeG6GPxF jVNWHREj4MN2 

TaoTL2kmVTT 


NOU PWN PR 


We have already discussed the Twitter integration properties in Chapter 8. The mail 
properties are used to configure the JavaMailSender bean in the Spring configuration 
except mail.to, which actually is the TO address of the user who gets all the notifications 
generated by the bot. 

We now turn our attention to the configuration of the core beans that make up 
the bot. The first is the configuration of the TradingConfig class. This class must be 
configured correctly for other services to work. We must also be careful to configure 
some of the values as they might affect the orders that are placed. For example, the 
maxAllowedQuantity is the maximum size of an order placed. In our case, it is just 5, but 
changing this value to, say, 50000 will place a huge order, which might lead to a margin 
call if the trade goes in the opposite direction. 

Let’s briefly discuss each of the config params in the TradingConfig class: 


e minReserveRatio is the ratio of the amount available to trade to 
the total amount in the account. A value of 0.1 stipulates that if 
this amount falls below 10%, the bot stops putting in new orders. 
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e maxAllowedNetContracts is the maximum net the bot will go 
long or short on a given currency. This setting was inspired by the 
event on Jan 15, 2015, when SNB? unexpectedly ended the CHF 
peg versus EUR of 1.2 and CHF soured by nearly 30%. Anyone 
who was massively short CHF ended up losing huge amounts of 
money. 


e minAmountRequired is the minimum balance in the designated 
currency of the account required to allow the bot to place 
orders. If the balance falls below this threshold, no further order 
placement is possible. 


e¢  max10yrWmaOffset defines the safe zone of a currency 
pair. We discussed it in detail while discussing 
PreOrderValidationService. 


e  fadeTheMovePriceExpiry is the time in minutes, the observation 
interval, for the FadeTheMove strategy. 


e  fadeTheMoveJumpReqdToTrade is the net jump in pips required 
during the fadeTheMovePriceExpiry that will create a scenario to 
place limit orders in the opposite direction of the market move. 


e  fadeTheMoveDistanceToTrade is the distance from the 
current price in pips when the limit order placed by the 
FadeTheMoveStrategy will be filled. 


e fadeTheMovePipsDesired is the profit desired in pips for the 
FadeTheMove strategy. 


1 <bean id="tradingConfig" 

2 class="com.precioustech. fxtrading.tradingbot. TradingConfig"> 

3 <property name="minReserveRatio" value="0.1"/> 

4 <property name="maxAllowedQuantity" value="10"/> 

5 <property name="maxAllowedNetContracts" value="5"/> 

6 <property name="minAmountRequired" value="10.0"/> 

7 <property name="mailTo" value="${mail.to}"/> 

8 <property name="max10yrWmaOffset" value="0.1"/> 

9 <property name="fadeTheMoveJumpReqdToTrade" value="45"/> 


10 <property name="fadeTheMoveDistanceToTrade" value="25"/> 
11 <property name="fadeTheMovePipsDesired"” value="10"/> 
12 <property name="fadeTheMovePriceExpiry” value="15"/> 
13 </bean> 


Next we configure the Google EventBus and all the callback handlers that use 
the EventBus to disseminate the event payloads. We also configure the bean post 
processor FindEventBusSubscribers, which we discussed in the first chapter. It finds all 


*https://www.snb.ch/en/mmr/reference/pre_20150115/source/pre_20150115.en. pdf 
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classes with methods annotated by @Subscriber and registers them with the EventBus 
automatically. 


1 <bean id="eventBus" class="com.google.common.eventbus.EventBus"/> 
2 <bean id="findEventBusSubscribers" 

class="com.precioustech. fxtrading.tradingbot.spring. 
FindEventBusSubscribers"/> 

4 <bean id="eventCallback" 

5 class="com.precioustech. fxtrading.events.EventCallbackImp1"> 
6 <constructor-arg index="0" ref="eventBus"/> 

7 </bean> 
8 
9 
0 


w 


<bean id="heartBeatCallback" 
class="com.precioustech. fxtrading. heartbeats .HeartBeatCallbackImp1"> 


1 <constructor-arg index="0" ref="eventBus"/> 

11 </bean> 

12 <bean id="marketEventCallback" 

13 class="com.precioustech. fxtrading.marketdata.MarketEventHandlerImp1"> 
14 <constructor-arg index="0" ref="eventBus"/> 

15 </bean> 


For the JavaMailSender bean, the configuration looks like this: 


1 <bean id="mailSender" class="org.springframework.mail.javamail. 
JavaMailSenderImp1"> 

2 <property name="host" value="${mail.host}"/> 

3 <property name="port" value="${mail.port}"/> 

4 <property name="username" value="${mail.user}"/> 

5 <property name="password" value="${mail.password}"/> 

6 <property name="javaMailProperties"> 

7 <props> 

8 <prop key="mail.transport.protocol">smtps</prop> 

9 <prop key="mail.smtp.auth">true</prop> 

10 <prop key="mail.smtp.starttls.enable">true</prop> 

11 <prop key="mail.smtp.socketFactory.class">javax.net.ssl. 

SSLSocketFactory</prop> 

12 <prop key="mail.debug">false</prop> 

13 <prop key="mail.smtp.socketFactory.fallback">false</prop> 

14 </props> 

15 </property> 

16 </bean> 


The placeholders for this bean are defined in the tradingbot. properties file. A 
related service that uses the JavaMailSender bean to send out notifications is configured 
as follows: 


1 <bean id="eventEmailNotifier" 


2 class="com.precioustech. fxtrading.tradingbot.events.notification. 
email. EventEmailNotifier"/> 
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The orderQueue is used to place orders and has a very simple configuration. 
1 <bean id="orderQueue" class="java.util.concurrent.LinkedBlockingQueue"/> 


We use the built-in Spring Task Scheduler [“sprsched] to schedule our jobs. An 
example job is polling new tweets for our configured Twitter accounts. 


1 <task:scheduler id="taskScheduler" pool-size="5"/> 


Twitter-Related Beans Configuration 


We first configure TwitterTemplate, which enables all interaction with Twitter and is part 
of Spring Social. 


1 <bean id="twitter" class="org.springframework.social.twitter.api.impl. 
TwitterTemplate"> 


2 <constructor-arg index="0" value="${twitter. 
consumerKey}"/> 

3 <constructor-arg index="1" value="${twitter. 
consumerSecret}"/> 

4 <constructor-arg index="2" value="${twitter. 
accessToken}"/> 

5 <constructor-arg index="3" value="${twitter. 


accessTokenSecret}"/> 
6 </bean> 


The placeholders for the configuration are all defined in the tradingbot. properties 
file, which we discussed in the previous section. It’s pretty self-explanatory. 

Next we configure a bean that is a list of all Twitter accounts for which we want to 
process the tweets. Although not a dependency for other beans, it is used by SpEL to inject 
values. For example: 


1 <bean id="fxTweeterList" class="java.util.ArrayList"> 

2 <constructor-arg index="0"> 

3 <list> 

4 <value>SignalFactory</walue> 
5 <value>Forex_EA4U</value> 
6 </list> 

7 </constructor-arg> 

8 </bean> 

9 <utils:map id="tweetHandlerMap"> 

10 <entry key="#{fxTweeterList[0]}"> 

11 <bean class= 


12. "com.precioustech. fxtrading.tradingbot.social. twitter. tweethandler. 
SignalFactoryFXTweetHandler"> 
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13 <constructor-arg index="0" value="#{fxTweeter 
List[0]}"/> 

14 </bean> 

15 </entry> 

16 <entry key="#{fxTweeterList[1]}"> 

17 <bean class= 

18 "com. precioustech. fxtrading.tradingbot.social.twitter. 

tweethandler.ZuluTrader101FXTweetHandler"> 

19 <constructor-arg index="0" value="#{fxTweeter 
List[1]}"/> 

20 </bean> 

21 </entry> 


22 </util:map> 


The SpEL enables us to define all the Twitter accounts in once place and then 
reference the list via expressions and inject the value of these expressions into other 
beans. 

If we need to listen to more Twitter accounts for tweets, we just create or reuse 
existing handlers (if applicable) and configure them here. 


Provider Beans Configuration 


In this section, we configure all the beans that implement the Provider interfaces and 
are provider-specific. Since our discussion throughout the book has been based on the 
OANDA REST API, we define it inside its own configuration called tradingbot-oanda. xml 
and which has all its properties defined in the tradingbot-oanda. properties file. 

It is important that the ID given to the beans in this OANDA config file be reused 
in other provider implementations, since the main configuration references this ID to 
configure the core services bean. 

We begin by looking at the properties file: 


1 oanda.url=https://api-fxtrade.oanda.com 

2 oanda.accessToken=7d741¢1234f25d9f5a094e53a356789b-2c¢9a7b49578904 
€177210af8e111c2f6 

oanda.userName=foo 

oanda.accountId=123456 

5 oanda.streaming.url=https://stream-fxtrade.oanda.com 


Rw 


e oanda.ur] is the URL we want to point our trading bot to. 
Remember we have the live, practice, and sandbox environments 
provided by OANDA. 


e¢  oanda.streaming.url is the streaming URL for tick data and 
platform events. 


e oanda.accessToken is the token that was generated in the 
environment pointed by oanda.url. 
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e oanda.userxName is a valid username in the environment pointed 
by oanda.url. 


e oanda.accountId is a valid account belonging to the value 
configured for oanda. userName in the environment pointed by 
oanda.url. A valid account ID is required to start a market data 
stream, for example. 


We provide the location of this properties file, as usual as a classpath location, and 


turn on the annotation processing, like we did for the main configuration file. 


1 
2 


<context: annotation-config/> 
<context:property-placeholder location="classpath:tradingbot-oanda. 
properties" 

ignore-unresolvable="true"/> 


We now list the configurations for all the OANDA provider services. 


AccountDataProviderService 


1 <bean id="accountDataProvider" class= 

2 "com.precioustech. fxtrading.oanda.restapi.account. 
OandaAccountDataProviderService"> 

3 <constructor-arg index="0" value="${oanda.url}"/> 

4 <constructor-arg index="1" value="${oanda.userName}"/> 

5 <constructor-arg index="2" value="${oanda.accessToken}"/> 

6 </bean> 

ProviderHelper 

1 <bean id="providerHelper" 

2 class="com.precioustech. fxtrading.oanda.restapi.helper. 


OandaProviderHelper"/> 


InstrumentDataProvider 


= 


<bean id="instrumentDataProvider" 
class="com.precioustech. fxtrading.oanda.restapi. instrument. 
OandaInstrumentDataProviderService"> 
<constructor-arg index="0" value="${oanda.url}"/> 
<constructor-arg index="1" value="${oanda.accountId}"/> 
<constructor-arg index="2" value="${oanda. 
accessToken}"/> 
</bean> 
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CurrentPricelnfoProvider 


1 <bean id="currentPriceInfoProvider" 
class="com. precioustech. fxtrading.oanda.restapi.marketdata. 
OandaCurrentPriceInfoProvider"> 
<constructor-arg index="0" value="${oanda.url}"/> 
4 <constructor-arg index="1" value="${oanda. 
accessToken}"/> 


N 


Ww 


5 </bean> 


HistoricMarketDataProvider 


1 <bean id="historicMarketDataProvider" 


2 class="com. precioustech. fxtrading.oanda.restapi.marketdata.historic. 
OandaHistoricMarketDataProvider"> 
3 <constructor-arg index="0" value="${oanda.url}"/> 


4 <constructor-arg index="1" value="${oanda. 
accessToken}"/> 
5 </bean> 


OrderManagementProvider 


1 <bean id="orderManagementProvider" 


2 class="com.precioustech. fxtrading.oanda.restapi.order. 
OandaOrderManagementProvider"> 
3 <constructor-arg index="0" value="${oanda.url}"/> 
4 <constructor-arg index="1" value="${oanda. 
accessToken}"/> 
5 <constructor-arg index="2" ref="accountDataProvider"/> 
6 </bean> 


TradeManagementProvider 


1 <bean id="tradeManagementProvider" 
2 class="com.precioustech. fxtrading.oanda.restapi.trade. 
OandaTradeManagementProvider"> 
3 <constructor-arg index="0" value="${oanda.url}"/> 
4 <constructor-arg index="1" value="${oanda. 
accessToken}"/> 
5 </bean> 
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PositionManagementProvider 


1 <bean id="positionManagementProvider" 


2 class="com.precioustech. fxtrading.oanda.restapi.position. 
OandaPositionManagementProvider"> 
3 <constructor-arg index="0" value="${oanda.url}"/> 


4 <constructor-arg index="1" value="${oanda. 
accessToken}"/> 
5 </bean> 


EventStreamingService 


1 <bean id="eventsStreamingService" 


2 class="com.precioustech. fxtrading.oanda.restapi.streaming.events. 
OandaEventsStreamingService"> 

3 <constructor-arg index="0" value="${oanda.streaming. 
url}"/> 

4 <constructor-arg index="1" value="${oanda. 
accessToken}"/> 

5 <constructor-arg index="2" ref="accountDataProvider"/> 

6 <constructor-arg index="3" ref="eventCallback"/> 

7 <constructor-arg index="4" ref="heartBeatCallback"/> 

8 <constructor-arg index="5" value="EVENTSTREAM"/> 

9 </bean> 


We assign the source ID EVENTSTREAM as a heartbeat source ID, since the same class 
is responsible for handling the event heartbeats. 


Platform Event Handlers 


1 <bean id="orderEventHandler" 
2 class="com.precioustech. fxtrading.oanda.restapi.events. 
OrderFilledEventHandler"> 


3 <constructor-arg index="0" ref="tradeInfoService"/> 

4 </bean> 

5 <bean id="tradeEventHandler" 

6 class="com.precioustech. fxtrading.oanda.restapi.events. 
TradeEventHandler"> 

7 <constructor-arg index="0" ref="tradeInfoService"/> 

8 </bean> 
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These event handlers need to be assigned to platform events that they will handle: 


1 <utilsmap id="eventEmailContentGeneratorMap" key-type="com. 


precioustech. fxtrading.events.Event"> 


2 <entry 

3 key="#{T(com.precioustech. fxtrading.oanda.restapi. 
OrderEvents) .MARKET ORDER_CREATE}" 

4 value-ref="orderEventHandler"/> 

5 <entry 

6 key="#{T(com.precioustech. fxtrading.oanda.restapi. 
OrderEvents).LIMIT ORDER _CREATE}" 

7 value-ref="orderEventHandler"/> 

8 <entry 

9 key="#{T(com. precioustech. fxtrading.oanda.restapi. 
OrderEvents) .ORDER_CANCEL}" 

10 value-ref="orderEventHandler"/> 

11 <entry 

12 key="#{T(com. precioustech. fxtrading.oanda.restapi. 
OrderEvents) .ORDER_FILLED}" 

13 value-ref="orderEventHandler"/> 

14 <entry 

15 key="#{T(com. precioustech. fxtrading.oanda.restapi. 
TradeEvents).TRADE_CLOSE}" 

16 value-ref="tradeEventHandler"/> 

17 <entry 

18 key="#{T(com. precioustech. fxtrading.oanda.restapi. 
TradeEvents).STOP_ LOSS FILLED}" 

19 value-ref="tradeEventHandler"/> 

20 <entry 

21 key="#{T(com. precioustech. fxtrading.oanda.restapi. 


TradeEvents).TAKE PROFIT FILLED}" 
22 value-ref="tradeEventHandler"/> 
23. </utilsmap> 


We configure the eventEmailContentGeneratorMap map to express interest in 
notifications that we want the bot to generate when the platform event is generated. The 
corresponding handlers are responsible for generating the content for the e-mail. as 


discussed in the previous chapter. 


MarketDataStreamingService 


1 <bean id="marketDataStreamingService" 


2 class="com.precioustech. fxtrading.oanda.restapi.streaming.marketdata. 
OandaMarketDataStreamingService"> 
3 <constructor-arg index="0" value="${oanda.streaming. 
url}"/> 
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<constructor-arg index="1" 
accessToken}"/> 
<constructor-arg index="2" 
<constructor-arg index="3" 
List"/> 

<constructor-arg index="4" 
<constructor-arg index="5" 
<constructor-arg index="6" 

</bean> 


value="${oanda. 


value="${oanda.accountId}"/> 
ref="tradeableInstrument 


ref="marketEventCallback"/> 
ref="heartBeatCallback"/> 
value="MKTDATASTREAM"/> 


We assign the source ID MKTDATASTREAM as a heartbeat source ID, since the same 
class is responsible to tick data heartbeats. 
The tradeableInstrumentList is the list of instruments for which we want to 
subscribe tick data from the OANDA platform. The list is configured as follows: 


1 <bean id="tradeableInstrumentList" class="java.util.ArrayList"> 
2 <constructor-arg index="0"> 
3 <list> 
4 <bean class="com.precioustech. fxtrading. 
instrument. TradeableInstrument"> 
5 <constructor-arg index="0" value="USD CAD"/> 
6 </bean> 
7 <bean class="com.precioustech. fxtrading. 
instrument. TradeableInstrument"> 
8 <constructor-arg index="0" value="GBP_USD"/> 
9 </bean> 
10 <bean class="com.precioustech. fxtrading. 
instrument. TradeableInstrument"> 
11 <constructor-arg index="0" value="AUD_JPY"/> 
12 </bean> 
13 <bean class="com.precioustech. fxtrading. 
instrument. TradeableInstrument"> 
14 <constructor-arg index="0" value="EUR_NZD"/> 
15 </bean> 
16 <bean class="com.precioustech. fxtrading. 
instrument. TradeableInstrument"> 
17 <constructor-arg index="0" value="GBP_CHF"/> 
18 </bean> 
19 <bean class="com.precioustech. fxtrading. 
instrument. TradeableInstrument"> 
20 <constructor-arg index="0" value="EUR_JPY"/> 
21 </bean> 
22 </list> 
23 </constructor-arg> 
24 </bean> 
This concludes our discussion of the configuration of all the provider beans for the 
OANDA implementation. 
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Strategies Configuration 


In this book we discussed a couple of strategies that happen to get activated via a 
scheduler-based invocation. In this section we configure them and show how they are 
invoked. 


1 <bean id="fadeTheMoveStrategy" 
2 class="com.precioustech. fxtrading.tradingbot.strategies. 
FadeTheMoveStrategy"> 
<constructor-arg index="0" ref="tradeableInstrumentList"/> 
</bean> 
<bean id="copyTwitterStrategy" 
class="com.precioustech. fxtrading.tradingbot.strategies. 
CopyTwitterStrategy"/> 


anu & WwW 


The configuration is fairly straightforward. The FadeTheMove strategy has an 
additional constructor dependency that gets injected with a list of instruments to observe 
and place an order if the given conditions are met. 

Now we look at the scheduler configuration that invokes a given strategy bean 
method after every time interval T: 


1 <task:scheduled-tasks scheduler="taskScheduler"> 


2 <task:scheduled ref="fadeTheMoveStrategy" 
method="analysePrices" 

3 fixed-delay="60000"/> 

4 <task: scheduled ref="copyTwitterStrategy" 
method="harvestAndTrade" 

5 fixed-delay="300000"/> 


6 </task:scheduled-tasks> 


The scheduler invokes every 60000ms the analysePrices() method of the 
fadeTheMoveStrategy bean. It also invokes every 300000ms the harvestAndTrade() 
method of the copyTwitterStrategy bean. 


Services Configuration 


In this concluding section on configuration, we discuss how to configure the core services 
of the bot. These services could be considered the public API of the bot if there were a 
GUI client or for that matter any other client interacting with the bot. Most of the demo 
programs in this book directly interact with these services. 


AccountinfoService 

1 <bean id="accountInfoService" 

2 class="com.precioustech. fxtrading. account .AccountInfoService"> 
3 <constructor-arg index="0" ref="accountDataProvider"/> 
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4 <constructor-arg index="1" ref="currentPriceInfoProvider"/> 
5 <constructor-arg index="2" ref="tradingConfig"/> 

6 <constructor-arg index="3" ref="providerHelper"/> 

7 </bean> 


InstrumentService 

1 <bean id="instrumentService" 

2 class="com.precioustech. fxtrading. instrument. InstrumentService"> 

3 <constructor-arg index="0" ref="instrumentDataProvider"/> 
4 </bean> 


MovingAverageCalculationService 


1 <bean id="movingAverageCalculationService" 


2 class="com.precioustech. fxtrading.marketdata.historic. 
MovingAverageCalculationService"> 

3 <constructor-arg index="0" ref="historicMarketData 
Provider"/> 

4 </bean> 

OrderinfoService 

1 <bean id="orderInfoService" 

2 class="com.precioustech. fxtrading. order .OrderInfoService"> 

3 <constructor-arg index="0" ref="orderManagementProvider"/> 

4 </bean> 

TradelnfoService 


1 <bean id="tradeInfoService" 

2 class="com.precioustech. fxtrading. trade. TradeInfoService"> 

3 <constructor-arg index="0" ref="tradeManagementProvider"/> 
4 <constructor-arg index="1" ref="accountInfoService"/> 

5 </bean> 


PreOrderValidationService 


1 <bean id="preOrderValidationService" 

2 class="com.precioustech. fxtrading.order.PreOrderValidationService"> 
3 <constructor-arg index="0" ref="tradeInfoService"/> 

4 <constructor-arg index="1" ref="movingAverageCalculationService"/> 
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5 <constructor-arg index="2" ref="tradingConfig"/> 
6 <constructor-arg index="3" ref="orderInfoService"/> 
7 </bean> 


OrderExecutionService 


1 <bean id="orderExecutionService" 

2 class="com.precioustech. fxtrading.order.OrderExecutionService"> 
3 <constructor-arg index="0" ref="orderQueue"/> 

4 <constructor-arg index="1" ref="accountInfoService"/> 

5 <constructor-arg index="2" ref="orderManagementProvider"/> 

6 <constructor-arg index="3" ref="tradingConfig"/> 

7 <constructor-arg index="4" ref="preOrderValidationService"/> 
8 <constructor-arg index="5" ref="currentPriceInfoProvider"/> 
9 </bean> 


DefaultHeartBeatService 


1 <bean id="heartBeatService" 
2 class="com.precioustech. fxtrading. heartbeats. 
DefaultHeartBeatService"> 


3 <constructor-arg index="0"> 

4 <list> 

5 <ref bean="eventsStreamingService"/> 

6 <ref bean="marketDataStreamingService"/> 
7 </list> 

8 </constructor-arg> 

9 </bean> 


Building the Bot 


The bot can easily be built using maven. Since there are three projects that need to be 
built in a given order, we can script the actions, instead of having to remember the build 
order. If you have cloned the code repository from GitHub, there is a buildbot.bsh file in 
the <repo-code>/java directory that will build the bot using maven. Figure 12-1 shows 
my bash terminal after having cloned the repository. 


256 


CHAPTER 12 | CONFIGURATION, DEPLOYMENT, AND RUNNING THE BOT 


(ShekharMacBook:java shekhar$ pwd 

/Volumes/05/ gi t/book-code/java 

(ShekharMacBook:java shekhar$ ls -1 

total 8 

-rwxr-xr-xX 1 shekhar staff 324 31 Jan 16:43 buildbot.bsh 

drwxr-xr-x 9 shekhar staff 306 31 Jan 17:32 oanda-restapi 

drwxr-xr-x 11 shekhar staff 374 31 Jan 17:32 tradingbot-app 
drwxr-xr-x 9 shekhar staff 306 31 Jan 17:32 tradingbot-core 
drwxr-xr-x 10 shekhar staff 348 27 Jan 20:10 tradingbot-demo-programs 
ShekharMacBook:java shekhar$ 


Figure 12-1. Code repo structure 


Before running the code, it is assumed that maven and Java 1.7 are installed and 
configured. When you type the mvn --version is typed command on the command line, 
you'll see output similar to what’s shown in Figure 12-2. 


ShekharMacBook: java shekhar$ avn version 

Apache Maven 3.2.5 (12a6b3acb947671169bD81149094c53f426d6ceal; 2614-12-14718:29:23*61:66) 
Maven home: /usr/local/Cellar/maven/3,2.5/libexec 

Java version: 1.7.6_71, vendor: Oracle Corporation 

Java home: /Library/Java/Java¥irtualMachines/jdk1.7.6_71.jdk/Contents/Home/jre 

Default locale: en_US, platform encoding: UTF-8 

OS name: “mac os x", version: "16.11", arch: “x86_64", family: “mac” 
ShekharMacBook:java shekhar$ Tl 


Figure 12-2. mvn -version output 


If this is not the case, make sure maven is properly installed’. 
We are now ready to run the buildbot.bsh script. Before that, let’s take a quick look 
at the script code: 


1 function buildmodule { 

2 cd $SCRIPT DIR/$1 

3 mvn clean install 

4 if [[ "$?" -ne 0 ]]; then 

5 echo "ERROR: $1 project build failed. BUILD FAILED"; exit -1; 
6 fi 

es 

8 SCRIPT _DIR="pwd* 

9  buildmodule tradingbot-core 


10  buildmodule oanda-restapi 

11 buildmodule tradingbot-app 

12 

13. echo "TRADING BOT built successfully" 


https: //maven.apache.org/install.html 
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drvxe-xr-x 10 shekhar stoeff 340 27 Jan 20:16 tradingbot-demo-prograns 

ShekharMacBook:java shekhar$ ./butldbot.bsh 

[INFO] Scamming for projects... 

[WARNING] 

(WARNING) Some probless vere encountered while building the effective model for com.precioustech: tradingbot-core:jar:1.0 
{[VARNING] ‘Duild.plugins.plugin.version’ for org. apache. maven, plugins:maven-compiler-plugin 1s missing. @ line 78, column 19 
[WARNING] 

(VARNING] [t 15 highly recommended to fix these problems because they threaten the stability of your build. 

[WARNING] 

(VARNING] For this reason, future Maven versions might no longer support building such malformed projects. 


(INFQ)! -->awnemennenanen-=acancnsancasemamas--anepnspmmnanwanamna=<annecsnn=-e 
[INFO] Building tradingbot-core 1.6 

({INFO} 
(VARNING] The artifact org. apache. commons:conmons-10: 
[[INFO} 

({INFO] --- maven-clean-plugin:2.S:clean (default-clean) @ tradingbot-core --- 

(LINFO] Deleting /Volumes/8S/gi t/book-code/java/tradingbot-core/target 

[INFO] 

{INFO} --- maven-resources-plugin:2.6:resources (default-resources) @ tradingbot-core --- 

[INFO] Using 'UTF-8' encoding to copy filtered resources 

[INFO] skip mon existing resourceDirectory /VYolumes/@5/¢1 t/book-code/java/tradingbot-core/src/main/resources 
{INFO} 

[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ tradingbot-core --- 

[INFO] Changes cetected - recompiling the module! 

({INFO] Compiling S@ source files to /Volumes/@S/gi t/book-code/java/tradingbot-core/target/classes 

(INFO 

({INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ tradingbot-core --- 

[INFO] Using ‘UTF-8' encoding to copy filtered resources. 

[INFO] Copying 2 resources 

INFO} 

[{INFO] --~ maven-compiler-plugin:3.1:testCompile (default-testCompile) @ tradingbot-core --- 

({INFO} Changes detected - recompiling the sodule! 

( INFO] Compiling 11 source files to /¥olumes/05/¢1 t/bDook-code/java/tradingbot-core/target/test-classes 
{INFO} 

[INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ tradingbot-core --- 

({INFO] Surefire report directory: /VYolumes/@S/¢1 t/book-code/java/tracingbot-core/target/surefire-reports 


1.3.2 nas been relocated to commons-to:commons-to:jar:1,.3,2 


Figure 12-3. Start build at the command line 


We call the function buildmodule for each of the three modules we want to build. 
The function first does a cd to the appropriate source code directory and then issues a 
mvn clean install command to build the artifacts (i.e., the jar file). If there are unit 
tests failure or compilation issues, mvn clean instal] will exit with a non-zero code. We 
check this code set in the $? variable, and if it’s non-zero, we exit the script straightaway. 
See Figure 12-4. 


Results 


Tests tn error 
findHt storicPnlTveetsforlInstrumentTest(com.precioustech, fxtrading, tradingbot. social. twitter, tweethandler, SignalfactoryfiTveetiandlerTest) 
TindHi storicPhalTveetsforinstrumentTest (com. preci oustech. fxtrading. tradingbot social. twitter. tweethandler, ZuluTraderlOlFxTveetiandlerTest) 


Tests rum: il, Fatlures: 0, Errors: 2, Skipped: 6 


{INFO} =*= 
I tweo} 
{iMeo) ~ 
{IMFO} 1 : 
[INFO] Finished at: 2016-01-31T16:42;14°02:00 

LINFO] Final Memory: 19/222" 

[INPOL |ncnenaensccenevesesecarecevscncaucvnesnssccpeart¥enespacsancadseedsesse 

(ERROR) Failed to execute goal org. spache. maven. plugins: maven-surefire-plugin:2.12,4: test (cefeult-test) on project tracingbot-spp: There are test failur 
cs. 

TERROR) 

TERROR) Please refer to /Voluses/05/e1t/code-repa/java/ tradingbet-app/tareet/suretire-reports for the individual test results. 

{ERROR} -> {Help 1) 


TERROR} To see the full stack trace of the errors. re-run Maven with the -e switch 

ERROR] Re-run Maven using the -X switch to ensble full debug logging 

{ERROR} 

[ERROR] For more information about the errors and possible solutions. please read the following articles: 


{ERROR} [Help 1] http: //cviki .apache.ogg/confluence/display/MAVEN/MojoFat lureException 
tradingbot-spp project build failed ——_ 
Tehetherier finn teue eheber€ wie bnttaRhe heh 


Figure 12-4. Build failure 
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If the build succeeds, we should see the output in Figure 12-5. 


Running com.prectoustech, fxtrading. tradingbot.events notification. ewatl.Event&mat Nott fierTest 
3 88 VARN [motn} No ematl content generator found for eventinull 
8. Errors 8 


SignalPactoryfXTveethandlerTest 


er. ZuluTraderl@LFxTveethandlerTest 


tradingdot-app 
ava/tradingbot-app/ target/tradingbot-app-1.8.j» 


install) @ tracingdot-spp 


ava/tradingbot-app/pom.xml to /Users/sheknar/ .m2/reposi tory/com/precioustech/txtrading/tradingbot-ap 


INFO] Totel time: 16.904 s 
(INFO) Fintshed at: 2016-81-31T17:32:45+61:90 
[INFO] Final Memory: 184/22SK 


LINFO] -- : . 
TRADING BOT built successfully <——— 


ShekhartacBook:java shekhar$ pwd 


Figure 12-5. Build success 


Running the Bot 


Warning — Serious losses can be incurred if some of the configuration values used to 
run the bot are extremely high. The author has taken every opportunity to highlight those 
throughout the book. In no event is the author liable for any consequential damages arising 
from the configuration values the user deems fit for his/her risk appetite. 


Now that the bot is fully built, we are ready to run it. But before we really push the 
button, we need to make sure the following config params have been adapted and a build 
is done so that these changes are in the JAR file for the given user. Here is the full checklist 
of changes: 


e AllOANDA-specific parameters in tradingbot-oanda. 
properties belong to the user of a valid live or practice account. 


e All Twitter-specific access tokens in tradingbot. properties 
are correctly populated. These valid tokens are generated for a 
Twitter app or for a Twitter account to which the user has full 
access. 
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e¢ Double-check that the values for the TradingConfig bean are 
within comfortable limits, especially maxAllowedQuantity, 
minReserveRatio, and maxAllowedNetContracts. 


e Configure a valid mail account in tradingbot. properties. The 
credentials are used to send e-mail notifications to the mail.to 


e-mail address. 


¢ Configure log4j. properties in the tradingbot-app resources 


directory if required. 


e Execute buildbot.sh again to rebuild the bot with the new set of 


parameters. 


To run the bot with the strategies discussed in the book and OANDA 


implementation, we simply do the following 


1  $ ./runbot-oanda.bsh 


If all goes well, you should see the output shown in Figure 12-6 coming from the bot. 


SneunarnecBock=}ave srwuner$ 


a 


199} Buti ding trociagbot-sop 1.0 
tego} == . 
[iseoy 

isso) erecomavensg 
2816-81-31 26:35:55,287 
tartwo date {Sen Jan 31 > 
2026-01-31 28:55:55, 978 


Wwgynid 4.82 pave (erault-cly) @ tracingret-app 
tno 


cm. precloustech. fxtraging tradingoot .FITragingBot.watnt)] 
t ef context Nierarchy 
am tatraging tradiegset 


FrTragingtet entre )) 


2OIGOh-31 2O.395:55. 7H fateading. tradingzet.FiTregingdot.setnt}l 
20N6GL+31 28:35:56, 383 Tatrecing t.FETragtngseot.eated )1 
2816-81-31 28:35:56,336 fa trading tradingoot .FxTradingBot wate] 
2026-G1-32 20:35:56, 363 tatraging et. FAT rasingBot. sain) 
2026-03-31 28:94: $6,489 Trtraging tragingoet Fi Tragingsot 

etting processed by all Sean exancle: not eligible for asto-pre 
2016-82-31 29°350 55,566 INFO Precious tech ta traeing. tragingnet .FiTragingset 


2016-81-31 26.95: 57.187 om. precioustech fa trading tradingnot .AiTrasingBot 
aridests 
2026-02-31 28°3°57,653 INFO 


Ldarins trunen tpi PRX sate re: 


tno 


tech frtraging. tragingzet PxTrasingset 


Tech. Txtraging. tragingzet.FaTragingset 


2926-01-31 28:35:59,291 INFO wrt 
at 

2096-02-31 20:95:59,627 INFO tech. fxtraging. tradingnot.AxTragingdot.watnt )I 
2036-05-32 28° 95°59,795 ENPO tech trtrasing tragingset FIT rasingset matn()] 
2026-61-31 28-95:59.008 INFO [cce. ore: lous tech. fa teaging. tragingnet aTreginedet saint | 
2026-02-51 20:95:59,967 INFO racing treauegnet FIT resingsot ul 
2046-04-31 26.36.09,078 INFO ocing. teagingDet .MTrasingBot .eaint)] 
2036-65-31 2) 96000,.274 INFO raaing. traduegnet FXTragingBot.watnt }] 
2NNG-OE-31 2834008, 907 INFO | ating tradingnot PiTraginghot saint) 
2026-03-31 20:36:00,933 Info aging. tragingdet.AITregingsot.eetnt )] 
2026-04-31 28:38:01,396 INFO poing Ureonngzet FiTragingset ” 
2096-02-31 28. 36.01,094 INFO one goo t PATrasingBot wate )} 
2016-81-31 20/26102, 282 INFO reaing Det. FXTrewingBot wet] 
26-01-91 PO MHD, TIA INFO | resing ngnet FE Trasinghot wat >} 
2026-03-32 20:26:09,772 ENFO raging. tragingset ATragingdet.watn )] 
ent 

2016-84-31 28.36.03, 797 INFO [cem.prectoustech. fa trading. tradingoet .MTragingBot wait)! 
2026-02-31 20:96:03,706 INFO thtraging. tragingnet.FETragingBot.aatnt )] 
2016-81-31 IO-MAT. BIA NFO [cow prectoustech frtrading teadingnet FXTraginghot maim )] 
Datatvent 


2026-63-31 28 


aS treserngtnrenc! 
conzceun, yee MTR 
Oba se ventstressingThrend} 


teecuting request 


Executing request 


31 28) 34004, 997 INFO | 
D1 206 :04,646 ENO | 
inFo 
tnro 
inpo | 
inPo | 


eomingThrend! 
narngincens} 
“ 


dane-tt 
2036-61 
2016-81 - 


© 
Creceting request 


Figure 12-6. Running the bot 
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AT neepses 


CAT pttpsi//apy 
OFT Witpsis/apt 


Refreshing org. springtrasework context. support. ClassPathtslapplicati onConter 4041798. 5 


Lending IM, Bran GeTiATttons Trem Class PATA resource [tracingbot-app xxl) 
Leading IML Bean defiestions free urce [tractngbot-oanda.2nt} 

[ teagingoet properties] 

[ tradingDot-oanss. properties} 


casing prope 
JGR-IIG "sewax.tnpect.Inpect’ srmotation found and supserted for autoviring 
Sean “eventhut” of type [class Com.google.common.eventaut.Event®us| 16 not eligiole for ¢ 


In talizing Executorservice *tasksened: 
Found event bus subscriber class Setaul thes 


eatService Subscriber method mame-nandlelte 


frecuting request : GET Rttps://apt-txtrace. conde. Com/vi/ Ins trumenteTaccount [+ MEMEBGETI® 


Executing request : GET RItps //apt-Txtrace.cange. com/vi/accountstusernamenqgsemFR HTTP 


Geecuting reqerst 1 GET https: //apt-fetrace.comde. com/vi/accounts/ MRMMMMONTTF/}. 1 
Eeecuting request 

Eeecuting regeest 

t ng request 

e re request 

Executing request 

e re request 

Evecuting request 

Erecuting request A nccoun Te mamma Cee NTT 
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While the bot is running, we should see it harvesting the tweet shown in Figure 12-7 
from time to time. 


Figure 12-7. New tweet harvested 


That is it. Our bot is now fully up and running. We should see that FadeTheMove 
strategy is very busy, especially around market moving currency events such as FOMC 
decision or GDP data from various countries. One point to bear in mind is that this 
strategy maintains an internal cache for the last 15 minutes. The more instruments you 
configure for subscription to tick the data stream, the more memory footprint you will 
have. Therefore, it may be imperative to run with a higher memory value. Since the bot 
runs inside maven, you would have to change the MAVEN_OPTS params. 
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CHAPTER 13 


Unit Testing 


In this chapter we discuss a very important topic, unit testing our code. Proper unit 
testing coverage of our bot will ensure that we do not create many regressions when we 
make changes or add enhancements to the existing code. For some of the target audience 
of this book, the trading bot may be deployed to place real orders with a live account 
where huge sums of money could be involved. Making sure that we have enough test 
coverage will ensure that a code bug would be unlikely to place bad orders. We briefly 
summarize the immense benefits of unit testing here. Proper unit tests: 


e —_ Eliminate most of the unlikely surprises in the production 
environment. 


e Help document the code. 


e Force a developer to develop and think in a way that leads to 
better design, code, and architecture of the system components. 


e Help developers write more maintainable code because they 
adopt the test-driven development approach. We are forced to 
write smaller classes so that they can be unit tested easily. 


e Help developers write loosely coupled components. Having many 
dependencies to mock forces us to think this way. 


Keeping these issues in mind, we will discuss some of the concepts and techniques 
of unit testing the bot in this chapter. 


Using Mockito as a Mocking Framework 


For writing unit tests for the bot, we are going to use Mockito’ extensively to create 
mocks for our objects. The mock for an object like TwitterTemplate helps to simulate the 
behavior of this object without having to instantiate it fully. In order to harvest tweets 
using a real TwitterTemplate, we have to provide valid tokens in order to authenticate 
with Twitter. This is not the real problem actually. The real problem is getting the same 
deterministic results every time we do a search query. This is impossible with the real 


‘http: //mockito.org/ 
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TwitterTemplate, as the tweets are constantly getting created and as a result the search 
results too. We cannot write deterministic asserts to unit test our code. To get around this 
problem, we use mocks and get deterministic results. The same applies to getting the 
deterministic order of price tick data from the provider, which is impossible in the real 
world. 


Mocking HTTP Interaction 


We need to be able to mock HTTP interaction in order to test our OANDA provider 
implementations. The concept is that this mock method, which we are going to explore 
shortly, returns an InputStream that is an instance of FileInputStream instead of a real- 
world instance of org.apache.http.client.entity.LazyDecompressingInputStream. 
Therefore, all of our interaction with OANDA comes from files of JSON payloads that we 
create instead of going to the OANDA platform. Let’s take a quick look at the code of this 
method: 


1 public static final void mockHttpInteraction(String fname, HttpClient 
mockHttpClient) throws Exception { 

2 CloseableHttpResponse mockResp = mock(CloseableHttpResponse.class); 

3 when(mockHttpClient.execute(any(HttpUriRequest.class))). 
thenReturn(mockResp) ; 


HttpEntity mockEntity = mock(HttpEntity.class); 


4 

5 

6 

7 when(mockResp.getEntity()).thenReturn(mockEntity) ; 

8 

9 StatusLine mockStatusLine = mock(StatusLine.class); 

0 

11 when(mockResp.getStatusLine()).thenReturn(mockStatusLine) ; 

12 when(mockStatusLine. getStatusCode()).thenReturn(HttpStatus.SC_OK); 
13 when(mockEntity.getContent()).thenReturn(new FileInputStream(fname) ) ; 
14 } 


The mockHttpInteraction method accepts a filename and a mock HttpClient as an 
argument. The last line of the method is where the magic happens after we have mocked 
all the interactions to get to this line. The HttpEntity object, which has the content 
returned from the OANDA REST API in the real world, is mocked to return the content of 
the file instead. 

This is a very useful concept that we just discussed. Now we are in a position to just 
about mock any interaction by mimicking the response in a file. Let’s look at an example 
of a unit test that does this interaction. 


@Test 

public void accountIdTest() throws Exception { 

final OandaAccountDataProviderService service = new 
OandaAccountDataProviderService(url, userName, accessToken); 
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assertEquals("https://api-fxtrade.oanda.com/v1/accounts/123456", 
service. getSingleAccountUrl(accountId)) ; 


OandaAccountDataProviderService spy = 
createSpyAndCommonStuff("src/test/resources/account123456.txt", 
service); 

Account < Long > accInfo = spy.getLatestAccountInfo(accountId) ; 

assertNotNull (accInfo) ; 

assertEquals("CHF", accInfo.getCurrency()); 

assertEquals(0.05, accInfo.getMarginRate(), OandaTestConstants. 

precision); 

assertEquals(-897.1, accInfo.getUnrealisedPnl(), OandaTestConstants. 

precision) ; 


i 


private OandaAccountDataProviderService createSpyAndCommonStuff (String 
fname, 

OandaAccountDataProviderService service) throws Exception { 
OandaAccountDataProviderService spy = spy(service); 


CloseableHttpClient mockHttpClient = mock(CloseableHttpClient.class); 
when(spy.getHttpClient()).thenReturn(mockHttpClient) ; 


OandaTestUtils.mockHttpInteraction(fname, mockHttpClient) ; 


return spy; 


} 


Before looking at the code in detail, let’s first look at the contents of the src/test/ 


resources/account123456. txt file used in this unit test case. 
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{ 
"accountId" : 123456, 
"accountName" : "main", 
"balance" : 20567.9, 
"unrealizedPl" : -897.1, 
"yealizedPl" : 1123.65, 
"marginUsed" : 89.98, 
"marginAvail" : 645.3, 
"openTrades" : 5, 
"openOrders"” : 0, 
"marginRate" : 0.05, 
"accountCurrency" : "CHF" 

} 
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The test begins by creating a real instance of the AccountDataProvider, in this 
case OandaAccountDataProviderService. We then create a spy’ on this object in the 
private method createSpyAndCommonStuff. Also inside this method we associate a mock 
HttpClient object that is used by the mockHttpInteraction method previously discussed 
to interact with the file that is passed as an argument to the method. 

So what happens when spy. getLatestAccountInfo(accountIqd) is invoked? 


1 private Account < Long > getLatestAccountInfo(final Long accountId, 
2 CloseableHttpClient httpClient) { 

3 try { 

4 HttpUriRequest httpGet = new HttpGet(getSingleAccountUrl(accountId)); 
5 httpGet . setHeader(authHeader) ; 

6 

7 LOG. info(TradingUtils.executingRequestMsg(httpGet) ) ; 

8 HttpResponse httpResponse = httpClient.execute(httpGet) ; 

9 String strResp = TradingUtils.responseToString(httpResponse) ; 

10 

11 


e ThecodeHttpResponse httpResponse = httpClient. 
execute(httpGet) returns a mock CloseableHttpResponse 
object (refer to method mockHttpInteraction). 


e When TradingUtils.responseToString is invoked with this 
mock httpResponse object, the call to entity. getContent inside 
this method returns an InputStream object which is actually an 
instance of FileInputStream that has a handle on the src/test/ 
resources/account123456. txt file used in the unit test. 


e When this InputStream method is read, the underlying file is read 
and the contents returned from the method. 


e This response is then parsed in the normal way, as is done from 
the actual OANDA platform when the HTTP 200 code is returned. 


For reference, TradingUtils.responseToString is as follows: 


/** 

* A utility method that tries to toString an HttpResponse object. Only 
* when HTTP status 200 is returned by the server, will this method 

* attempt to process the response. 

* 

* @param response 

* @return a String representation of the response if possible else an 
* empty string. 

* @throws IOException 

af 
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*http://docs.mockito.googlecode.com/hg/1.9.5/org/mockito/Spy. html 
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11 public static final String responseToString(HttpResponse response) 
throws IOException { 

12 HttpEntity entity = response.getEntity(); 

13 if ((response.getStatusLine().getStatusCode() == HttpStatus.SC OK || 

14 response. getStatusLine().getStatusCode() == HttpStatus.SC_ CREATED) 

&& entity != null) { 

15 InputStream stream = entity.getContent(); 

16 String line; 

17 BufferedReader br = new BufferedReader(new InputStreamReader(stream) ) ; 

18 StringBuilder strResp = new StringBuilder(); 

19 while ((line = br.readLine()) != null) { 

20 strResp.append(line) ; 

21 

22 IOUtils.closeQuietly(stream) ; 

23 IOUtils.closeQuietly (br); 

24 return strResp.toString(); 

25 } else { 

26 return StringUtils.EMPTY; 

27 } 

28 =} 

Mocking Streams 


In this section, we discuss how we can unit test streams discussed in the book, i.e., the 
market data stream and trade/order/account event stream. We are going to use exactly 
the same technique, i.e., using the mocking techniques described in the previous section 
to unit test them. Like before, we switch the InputStream available from the HttpGet to 
that of a FileInputStream, each line of which is an event in a JSON format. An extract 
from our unit test file looks like this: 


{"tick": {"instrument™: "AUD CAD", "time": "1401919213548144", 
"bid": 1.01479, "ask":1.01498}} 

{"tick": {"instrument™: "NZD SGD", "time": "1401919213548822", 
"bid": 1.07979, "ask" :1.07998}} 

{"heartbeat": {"time":"1401919213548226"}} 

{"tick": {"instrument": "AUD CAD", "time": "1401919217201682", 
"bid": 1.01484, "ask": 1.01502}} 

{"tick": {"instrument™: "NZD SGD", "time": "1401919217201500", 
"bid": 1.07984, "ask": 1.08002}} 

{"tick": {"instrument": "AUD CAD", "time": "1401919217206100", 
"bid": 1.01484, "ask": 1.01504}} 

{"tick": {"instrument": "NZD SGD", "time": "1401919217206465", 
"bid": 1.07984, "ask":1.08004}} 

{"heartbeat" : {"time" : "1401919217206269"}} 

{"tick": {"instrument": "AUD CAD", "time": "1401919221292441", 
"bid" :1.0149,"ask":1.01505}} 
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{"tick": {"instrument": "NZD SGD", "time": "1401919221292791", 
"bid": 1.07990, "ask": 1.08005 }} 

{"tick": {"instrument": "AUD CAD", "time": "1401919221297498", 
"bid": 1.01484, "ask": 1.01505}} 

{"tick": {"instrument": "NZD SGD", "time": "1401919221297233", 
"bid" :1.07984, "ask": 1.08005}} 

{"heartbeat": {"time" : "1401919221297319"}} 

{"tick": {"instrument”: "AUD CAD", "time": "1401919224790916", 
"bid": 1.01489, "ask": 1.01505}} 

{"tick": {"instrument": "NZD SGD", "time": "1401919224790630", 
"bid": 1.07989, "ask": 1.08005 }} 

{"tick": {"instrument": "AUD CAD", "time": "1401919224795379", 
"bid": 1.01489, "ask": 1.01506}} 

{"tick": {"instrument": "NZD SGD", "time": "1401919224795198", 
"bid": 1.07989, "ask": 1.08006}} 

{"heartbeat": {"time": "1401919224795130" }} 

{"tick": {"instrument”: "AUD CAD", "time": "1401919224800549", 
"bid": 1.01489, "ask": 1.01508}} 

{"tick": {"instrument": "NZD SGD", "time": "1401919224800275", 
"bid": 1.07989, "ask": 1.08008}} 


This file tries to mimic a live environment when there is a constant stream of tick 


data for instruments AUD_CAD and NZD_SGD. These ticks are interspersed with heartbeats, 
also mimicking the fact that the stream is alive. Let’s look at the actual test case that tests 
the OandaMarketDataStreamingService. We want to test that this service handles the 
tick data and heartbeats coming in correctly and calls the relevant callback handlers to 
disseminate the events downstream via EventBus. The test will have one of the asserts 
being that the count of events in the file matches the events pushed downstream. Let’s 
look at the code and see how we can accomplish one of these asserts. 
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private static final int expectedPriceEvents = 668; // 1 for each 
private static final TradeableInstrument < String > AUDCAD = 
new TradeableInstrument < String > ("AUD CAD"); 
private static final TradeableInstrument < String > NZDSGD = 
new TradeableInstrument < String > ("NZD SGD"); 
@Test 
public void marketDataStreaming() throws Exception { 
Collection < TradeableInstrument < String >> instruments = Lists. 
newArrayList(); 
EventBus eventBus = new EventBus(); 
MarketEventCallback < String > mktEventCallback = new 
MarketEventHandlerImpl < String > (eventBus); 
HeartBeatCallback < DateTime > heartBeatCallback = new 
HeartBeatCallbackImpl < DateTime > (eventBus); 
eventBus. register (this) ; 
instruments .add(AUDCAD) ; 
instruments .add(NZDSGD) ; 
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OandaStreamingService service = 
new OandaMarketDataStreamingService(OandaTestConstants.streaming url, 
OandaTestConstants.accessToken, OandaTestConstants.accountId, 
instruments, mktEventCallback, heartBeatCallback, "TESTMKTSTREAM") ; 
assertEquals("https://stream-fxtrade.oanda.com/v1/prices" + "?accoun 
tId=123456&instruments=AUD_CAD%2CNZD_ SGD", 
service. getStreamingUr1()); 
OandaStreamingService spy = 
setUpSpy(service, "src/test/resources/marketData123456.txt") ; 
assertEquals(expectedPriceEvents / 2, audcadCt); 
assertEquals(expectedPriceEvents / 2, nzdsgdCt); 
assertEquals(expectedPriceEvents / 4, heartbeatCt); 
MarketDataPayLoad < String > audcadPayLoad = audcadLastRef.get(); 
assertEquals(1.0149, audcadPayLoad.getBidPrice(), OandaTestConstants. 
precision) ; 
assertEquals(1.0151, audcadPayLoad.getAskPrice(), OandaTestConstants. 
precision); 
assertEquals(1401920421958 L, audcadPayLoad.getEventDate(). 
getMillis()); 
MarketDataPayLoad < String > nzdsgdPayLoad = nzdsgdLastRef.get(); 
assertEquals(1.0799, nzdsgdPayLoad.getBidPrice(), OandaTestConstants. 
precision); 
assertEquals(1.0801, nzdsgdPayLoad.getAskPrice(), OandaTestConstants. 
precision); 
assertEquals(1401920421958 L, nzdsgdPayLoad.getEventDate(). 
getMillis()); 
verify(spy, times(1)).handleDisconnect(disconnectmsg) ; 


private OandaStreamingService setUpSpy(OandaStreamingService service, 
String fname) throws Exception { 
OandaStreamingService spy = spy(service); 
CloseableHttpClient mockHttpClient = mock(CloseableHttpClient.class); 
when(spy.getHttpClient()).thenReturn(mockHttpClient) ; 
when(spy.isStreaming()).thenReturn(service.isStreaming()); 
OandaTestUtils.mockHttpInteraction(fname, mockHttpClient) ; 
spy.startStreaming(); 
do { 
Thread.sleep(2 L); 
} while (spy.streamThread.isAlive()); 
return spy; 


} 


The setUpSpy method performs the usual setup of the streaming service by first 


creating a spy on the underlying instance of OandaStreamingService, in this case it’s 
OandaMarketDataStreamingService. It then sets up the mockHttpInteraction whereby 
the src/test/resources/marketData123456.txt file will be set up as the source of 
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all events for the market data stream when the underlying service starts streaming by 
invoking spy. startStreaming(). 

Once the streaming starts, we wait for all the tick data and heartbeat events to be fully 
streamed. We set up a do-while loop with a sleep of 2ms as a wait mechanism for this to 
fully complete. The stream automatically stops once it receives a disconnect message, 
which is the last event in the file. The streams automatically stop once such a message 
arrives. This can happen sometimes when the OANDA platform detects that the number 
of streaming connections has been exceeded. The disconnect message looks like this: 


1 {"“disconnect": {"code":64, "message": "bye", "moreInfo": "none" }} 


The disconnect message leads to the termination of the stream and the background 
thread streamThread, which was set up as a quasi-infinite loop, also terminates. The 
method then returns to the caller. 

Now we must test that all the events were successfully delivered to the downstream 
subscribers via the EventBus. For the purposes of this test case, the test class itself is 
the end consumer of all these events. This was shown to be the case in our test case 
marketDataStreaming(), where we set this up while setting up the main service itself. 
Since we want to want to subscribe to the MarketDataPayLoad and HeartBeatPayLoad 
events, we set up the following dummy methods in the test class, which just count the 
events received. 


1 private volatile int audcadCt; 

2 private volatile int nzdsgdCt; 

3 private AtomicReference < MarketDataPayLoad < String >> audcadLastRef = 
4 new AtomicReference < MarketDataPayLoad < String >> (); 

5 private AtomicReference < MarketDataPayLoad < String >> nzdsgdLastRef = 
6 new AtomicReference < MarketDataPayLoad < String >> (); 

7 @Subscribe 

8 public void dummyMarketDataSubscriber(MarketDataPayLoad < String > 

payLoad) { 

9 if (payLoad.getInstrument().equals(AUDCAD)) { 
10 this. audcadCt++; 


11 this. audcadLastRef.set(payLoad) ; 

12 } else { 

13 this .nzdsgdCt++; 

14 this .nzdsgdLastRef.set(payLoad) ; 

15} 

16 =} 

17. @Subscribe 

18 public void dummyHeartBeatSubscriber(HeartBeatPayLoad < DateTime > 
payLoad) { 

19 heartbeatCt++; 

20 ~+} 


All the events from the file are directed at these methods, which keep a counter of events 


received belonging to the currency pair AUD_CAD and NZD_SGD in addition to the heartbeat 
events. The asserts then ensure that the count and order of events received were proper. 
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The Versatile verify Mockito 


So far we have focused on the HttpGet aspect of the interaction where reading from 

the file was fairly easy. However, to mock the opposite—i.e. inserting (HttpPost) a row, 

modifying a row (HttpPatch), and deleting a row (Httpdelete) from a file—is much 

more difficult, if not impossible. So how do we unit tests these interactions? The mockito 

verify comes to our rescue. The command helps verify interactions of a method and can 

optionally verify how many times it was invoked. Let’s explore the use case in more detail. 
To place a new order with the OANDA platform, we do the following at a high level: 


e Pass the fully populated Order POJO along with the account ID to 
the placeOrder method of the OandaOrderManagementProvider 
bean. 


e The placeOrder method internally delegates to the 
createPostCommand method, which creates a new instance of 
the HttpPost command and using the Order POJO getters. It 
populates the NameValuePair list on this post command. Once 
it’s fully populated, the command can then be posted to create an 
order. 


e Once the HttpPost succeeds, we get a response back. It is a JSON 
payload of the new order details if the command was successful. 


During unit testing, we do not want to post a real order to the OANDA platform 
and just want to validate that a valid HttpPost command was created, and verify can 
validate this for us. Since the creation of a valid HttpPost command pretty much invokes 
all getters of the Order POJO, the fact that verify reports a getter interaction one time 
(and more for some others) for each getter validates our code. Similarly, assuming a valid 
command was posted, we must then receive details of the new order as a JSON payload, 
which must then be read from a file as part of mockHttpInteraction, which we discussed 
earlier. 

Let’s look at the code that tests this case: 


1 = @Test 

2  @SuppressWarnings ("unchecked") 

3. public void createOrderTest() throws Exception { 

4 OandaOrderManagementProvider service = 

5 new OandaOrderManagementProvider (OandaTestConstants.url, 

6 OandaTestConstants.accessToken, null); 

7 TradeableInstrument < String > eurjpy = mew TradeableInstrument 
< String > ("EUR_JPY"); 


8 
9 OandaOrderManagementProvider spy = 
10 doMockStuff("src/test/resources/newOrder.txt", service); 


11 Order < String, Long > orderMarket = mock(Order.class); 

12 when(orderMarket.getInstrument()).thenReturn(eurjpy) ; 

13 when(orderMarket.getSide()).thenReturn(TradingSignal . SHORT) ; 
14 when(orderMarket.getType()).thenReturn(OrderType.MARKET) ; 

15 when(orderMarket.getUnits()).thenReturn(150 1); 
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16 when(orderMarket. getTakeProfit()).thenReturn(132.65); 

17 when(orderMarket.getStopLoss()).thenReturn(136.00) ; 

18 // when(order.getPrice()).thenReturn(133.75); 

19 Long orderId = 

20 spy.placeOrder(orderMarket, OandaTestConstants.accountId) ; 

21 assertNotNull (orderId) ; 

22 verify(spy, times(1)) 

23 .createPostCommand(orderMarket, OandaTestConstants.accountId); 
24 verify(orderMarket, times(1)).getInstrument(); 

25 verify(orderMarket, times(3)).getType(); 

26 verify(orderMarket, times(1)).getTakeProfit(); 

27 verify(orderMarket, times(1)).getStopLoss(); 

28 // verify(order, times(2)).getPrice(); 

29 verify(orderMarket, times(1)).getUnits(); 

30 verify(orderMarket, times(1)).getSide(); 

31 

32 spy = doMockStuff("src/test/resources/newOrderLimit.txt", service) ; 
33 Order < String, Long > orderLimit = mock(Order.class); 

34 TradeableInstrument < String > eurusd = 

35 new TradeableInstrument < String > ("EUR USD"); 

36 when(orderLimit.getInstrument()).thenReturn(eurusd) ; 

37 when(orderLimit.getSide()).thenReturn(TradingSignal . SHORT) ; 

38 when(orderLimit.getType()).thenReturn(OrderType.LIMIT) ; 

39 when(orderLimit.getUnits()).thenReturn(10 1); 

40 when(orderLimit.getTakeProfit()).thenReturn(1.09); 

41 when(orderLimit.getStopLoss()).thenReturn(0.0); 

42 when(orderLimit.getPrice()).thenReturn(1.10) ; 

43 

44 orderId = spy.placeOrder(orderLimit, OandaTestConstants.accountId) ; 
45 assertNotNull (orderId); 

46 verify(spy, times(1)) 

47 .createPostCommand(orderLimit, OandaTestConstants.accountId) ; 
48 verify(orderLimit, times(1)).getInstrument(); 

49 verify(orderLimit, times(3)).getType(); 

50 verify(orderLimit, times(1)).getTakeProfit(); 

51 verify(orderLimit, times(1)).getStopLoss(); 

52 verify(orderLimit, times(2)).getPrice(); 

53 verify(orderLimit, times(1)).getUnits(); 

54 verify(orderLimit, times(1)).getSide(); 

os: 

56 

57 private OandaOrderManagementProvider doMockStuff(String fname, 
58 OandaOrderManagementProvider service) 

59 throws Exception { 

60 OandaOrderManagementProvider spy = spy(service); 

61 CloseableHttpClient mockHttpClient = mock(CloseableHttpClient.class); 
62 when(spy.getHttpClient()).thenReturn(mockHttpClient) ; 
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63 OandaTestUtils.mockHttpInteraction(fname, mockHttpClient) ; 
64 return spy; 
65} 


In this test case, we test a new market and limit order; however, the mechanics are 
exactly the same. We create a mock Order POJO and, to create a successful HttpPost 
command, all the getters must be invoked on this mock object that defines a new order. 
The verify does exactly that—it verifies the getter interactions performed inside the 
createPostCommand. 


Mocking Twitter Interaction 


Mockito makes interacting with Twitter extremely easy. The only thing to bear in mind 
is that the search queries might differ for various user accounts when it comes to finding 
historic PNL tweets. Therefore, for every new user account handler we introduce, this test 
should be catered to its specific needs. 

To get mock tweets from Twitter that can be parsed for new trades or PNL tweets 
for all users, we must prepare the groundwork of the mock objects. That includes the 
following: 


e Creating a mock for Twitter interface (which is implemented by 
TwitterTemplate as part of Spring Social). 


e Creating a mock for the SearchOperations class, which is used to 
search for tweets given a search query. 


e Creating a mock for SearchResults that returns the mocked 
tweets when getTweets() is called on this object. 


e The invocation of the getTweets() method returns a list of tweet 
objects that can be a list of mocked tweet objects. The key is to 
intercept the getText() method on the individual mocked tweet 
object and return the text that we want. 


Let’s look at an example where we try to test the findHistoricPnlTweets method for 
the @SignalFactory user: 


1 = @Test 

2 public void findHistoricPnlTweetsForInstrumentTest() { 

3 AbstractFXTweetHandler < String > tweetHandler = new SignalFactory 
FXTweetHandler (userId) ; 

4 ProviderHelper providerHelper = mock(ProviderHelper.class) ; 

5 Twitter twitter = mock(Twitter.class); 

6 tweetHandler.providerHelper = providerHelper; 

7 tweetHandler.twitter = twitter; 

8 

9 


SearchOperations searchOperations = mock(SearchOperations.class) ; 
10 when(twitter.searchOperations()).thenReturn(searchOperations) ; 
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12 TradeableInstrument < String > nzdusd = new TradeableInstrument 
< String > ("NZD USD"); 

13 when(providerHelper.toIsoFormat(eq("NZD USD"))).thenReturn("NZDUSD") ; 

14 SearchResults searchResults = returnHistoricPnlSearchResults(); 

15 String query = "Profit: OR Loss: from:SignalFactory"; 

16 when(searchOperations.search(eq(query))).thenReturn(searchResults) ; 

17 Collection < Tweet > tweets = tweetHandler.findHistoricPnlTweetsForIn 
strument (nzdusd) ; 

18 assertEquals(1, tweets.size()); 

19} 

20 

21 =private SearchResults returnHistoricPnlSearchResults() { 

22 SearchResults searchResults = mock(SearchResults.class); 

23 List < Tweet > tweets = Lists.newArrayList(); 

24 when(searchResults.getTweets()).thenReturn(tweets) ; 

25 Tweet tweet = mock(Tweet.class); 

26 when(tweet.getText()).thenReturn( 

27 "Forex Signal | Close(SL) Sell NZDUSD@0.7744 | Loss: -40 pips | 
2015.02.06 11:26 GMT | #fx #forex #fb"); 

28 tweets.add(tweet) ; 

29 return searchResults; 

30} 


After setting up the mocks to return the list of tweets, we want to make sure that 
these tweets are returned only if the query that we expect to be fired is sent to the 
SearchOperations mock: 


1 String query = "Profit: OR Loss: from:SignalFactory"; 
2 when(searchOperations.search(eq(query) )).thenReturn(searchResults) ; 


The other important aspect of tweet handling for a given user is parsing new and 
closed trade tweets. The parsing is done on the actual tweet text returned from the 
getText() method. We want to make sure that we write test cases to cover all aspects of 
parsing new and closed trades tweets for a given Twitter user. 


EclEmma Code Coverage Tool for Eclipse IDE 


The EclEmma’ plug-in for the Eclipse IDE is an excellent tool for reporting code coverage 
for a Java project. You can run this tool for an individual test case or a suite of tests. 

Once EclEmma has been installed successfully, you can launch a test suite via the 
plug-in using the button shown in Figure 13-1. 
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Figure 13-1. Launch Test using EclEmma tool 
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The results appear in the Coverage view, as shown in Figure 13-2. 
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Figure 13-2. Summary of results for the tradingbot-core project 


that were executed as part of the unit test and which ones were left out. 
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13 « See the License for the specific language governing permissions and 
14 © Limitations under the License. 

15 o/ 

16 package com.precioustech. fxtrading. heartbeats; 

17 

18 import org.apache. commons. lang3.StringUtils; 

19 


20 public class HeartBeatPayload<T> { 
21 


22 private final T payload; 
23 private final String source; 


125 ublic HeartBestPayLoad(T payload) { 
26 
a 
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Figure 13-3. Code coverage for HeartBeatPayLoad 
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